Sep 25 16:58:00 devstack cinder-volume[76012]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 16:58:00 devstack cinder-volume[76012]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 16:58:00 devstack cinder-volume[76012]: we strongly recommend against using it for new projects. Sep 25 16:58:00 devstack cinder-volume[76012]: If you are already using Eventlet, we recommend migrating to a different Sep 25 16:58:00 devstack cinder-volume[76012]: framework. For more detail see Sep 25 16:58:00 devstack cinder-volume[76012]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 16:58:00 devstack cinder-volume[76012]: import eventlet # noqa Sep 25 16:58:02 devstack cinder-volume[76012]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:58:02 devstack cinder-volume[76012]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:58:02 devstack cinder-volume[76012]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:58:03 devstack cinder-volume[76012]: INFO dbcounter [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Registered counter for database cinder Sep 25 16:58:03 devstack cinder-volume[76012]: DEBUG oslo_db.sqlalchemy.engines [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76012) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:58:04 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writer thread running {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 16:58:04 devstack cinder-volume[76012]: INFO cinder.rpc [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 16:58:04 devstack cinder-volume[76012]: INFO cinder.rpc [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 16:58:04 devstack cinder-volume[76012]: DEBUG oslo_db.sqlalchemy.engines [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76012) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:58:04 devstack cinder-volume[76012]: INFO cinder.volume.manager [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Determined volume DB was empty at startup. Sep 25 16:58:04 devstack cinder-volume[76012]: DEBUG cinder.volume.manager [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76012) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 16:58:04 devstack cinder-volume[76012]: INFO cinder.volume.manager [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 16:58:04 devstack cinder-volume[76012]: WARNING stevedore.named [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 16:58:04 devstack cinder-volume[76012]: WARNING castellan.key_manager [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 16:58:04 devstack cinder-volume[76012]: WARNING cinder.keymgr.conf_key_mgr [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 16:58:04 devstack cinder-volume[76012]: DEBUG cinder.volume.drivers.lvm [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76012) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 25 16:58:04 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] CMD "cinder-rtstool verify" returned: 0 in 0.493s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_db.sqlalchemy.engines [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76012) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:58:05 devstack cinder-volume[76012]: INFO cinder.rpc [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 25 16:58:05 devstack cinder-volume[76012]: INFO cinder.rpc [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 25 16:58:05 devstack cinder-volume[76012]: WARNING stevedore.named [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 16:58:05 devstack cinder-volume[76012]: WARNING castellan.key_manager [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 16:58:05 devstack cinder-volume[76012]: INFO cinder.volume.manager [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_db.sqlalchemy.engines [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76012) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:58:05 devstack cinder-volume[76012]: INFO oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Starting 1 workers Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Started child 76170 {{(pid=76012) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Full set of CONF: {{(pid=76012) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] ******************************************************************************** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Configuration options gathered from: {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] ================================================================================ {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] allow_availability_zone_fallback = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] allow_compression_on_image_upload = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] allowed_direct_url_schemes = [] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] api_rate_limit = True {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] auth_strategy = keystone {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] az_cache_duration = 3600 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_availability_zone = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_host = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_name = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_stats_polling_interval = 60 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backup_api_class = cinder.backup.api.API {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backup_name_template = backup-%s {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backup_use_same_host = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backup_use_temp_snapshot = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] chap_password = **** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] chap_username = {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cinder_internal_tenant_project_id = 4cfe38f4207b4355a02d50dfd78b03c4 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cinder_internal_tenant_user_id = fa1640b086b44255a45bcfc0228e221c {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cloned_volume_same_az = True {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cluster = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] compression_format = gzip {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] compute_api_class = cinder.compute.nova.API {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] config_dir = [] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] config_source = [] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] control_exchange = openstack {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] debug = True {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] default_availability_zone = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] default_group_type = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] default_volume_type = lvmdriver-1 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] disk_geometry = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] driver_client_cert = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] driver_client_cert_key = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] driver_data_namespace = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] driver_ssl_cert_path = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] driver_ssl_cert_verify = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] driver_use_ssl = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] enable_force_upload = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] enable_new_services = True {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] enable_unsupported_driver = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] enabled_backends = ['lvmdriver-1'] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] enforce_multipath_for_image_xfer = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] filter_function = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] glance_api_insecure = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] glance_api_servers = ['http://192.168.122.10/image'] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] glance_api_ssl_compression = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] glance_ca_certificates_file = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] glance_catalog_info = image:glance:publicURL {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] glance_certfile = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] glance_keyfile = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] glance_num_retries = 3 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] glance_request_timeout = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] goodness_function = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] graceful_shutdown_timeout = 5 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] group_api_class = cinder.group.api.API {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] host = devstack {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] image_compress_on_upload = True {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] image_conversion_address_space_limit = 1 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] image_conversion_cpu_limit = 60 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] image_conversion_disable = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] image_introspection_address_space_limit = 1 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] image_introspection_cpu_limit = 60 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] image_upload_use_cinder_backend = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] image_upload_use_internal_tenant = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] image_volume_cache_enabled = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] image_volume_cache_max_count = 0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] image_volume_cache_max_size_gb = 0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] init_host_max_objects_retrieval = 0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] instance_format = [instance: %(uuid)s] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] iscsi_target_flags = {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] iscsi_write_cache = on {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] iser_helper = tgtadm {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] iser_ip_address = 192.168.122.10 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] iser_port = 3260 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] log_color = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] log_config_append = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] log_dir = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] log_file = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] log_options = True {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] log_rotate_interval = 1 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] log_rotate_interval_type = days {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] log_rotation_type = none {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76170]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] max_age = 0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] max_logfile_count = 30 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] max_logfile_size_mb = 200 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] max_over_subscription_ratio = 20.0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] message_reap_interval = 86400 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] message_ttl = 2592000 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] migration_create_volume_timeout_secs = 300 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] monkey_patch = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] monkey_patch_modules = [] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] my_ip = 192.168.122.10 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] no_snapshot_gb_quota = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] num_iser_scan_tries = 3 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] num_shell_tries = 3 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] num_volume_device_scan_tries = 3 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] nvmeof_conn_info_version = 1 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] nvmet_ns_id = 10 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] nvmet_port_id = 1 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] osapi_max_limit = 1000 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] osapi_volume_ext_list = [] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] osapi_volume_listen = 0.0.0.0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] osapi_volume_listen_port = 8776 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] osapi_volume_use_ssl = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] osapi_volume_workers = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] per_volume_size_limit = -1 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] periodic_fuzzy_delay = 60 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] periodic_interval = 60 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] project_id_regex = [0-9a-f\-]+ {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] public_endpoint = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] publish_errors = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] quota_backup_gigabytes = 1000 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] quota_backups = 10 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] quota_gigabytes = 1000 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] quota_groups = 10 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] quota_snapshots = 10 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] quota_volumes = 10 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] rate_limit_burst = 0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] rate_limit_except_level = CRITICAL {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] rate_limit_interval = 0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] reinit_driver_count = 3 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] replication_device = **** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] report_discard_supported = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] report_interval = 120 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] reservation_clean_interval = 86400 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] reservation_expire = 86400 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] reserved_image_namespaces = [] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] reserved_percentage = 0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] rpc_response_timeout = 120 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] run_external_periodic_tasks = True {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] scst_target_driver = iscsi {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] scst_target_iqn_name = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] service_down_time = 720 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] shell_completion = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] snapshot_name_template = snapshot-%s {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] snapshot_same_host = True {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] split_loggers = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] state_path = /opt/stack/data/cinder {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] storage_availability_zone = nova {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] storage_protocol = iSCSI {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] syslog_log_facility = LOG_USER {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] target_helper = lioadm {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] target_ip_address = 192.168.122.10 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] target_port = 3260 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] target_protocol = iscsi {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] target_secondary_ip_addresses = [] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] trace_flags = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] transfer_api_class = cinder.transfer.api.API {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] transport_url = **** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] until_refresh = 0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] use_chap_auth = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] use_default_quota_class = True {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] use_journal = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] use_json = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] use_multipath_for_image_xfer = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] use_stderr = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] use_syslog = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] verify_glance_signatures = enabled {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] volume_api_class = cinder.volume.api.API {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] volume_backend_name = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] volume_clear = zero {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] volume_clear_ionice = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] volume_clear_size = 0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] volume_copy_bps_limit = 0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] volume_dd_blocksize = 1M {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] volume_name_template = volume-%s {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] volume_service_inithost_offload = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] volume_usage_audit_period = month {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] zoning_mode = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_concurrency.disable_process_locking = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.auth_section = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.auth_type = password {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.auth_version = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.cache = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.certfile = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.delay_auth_decision = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.http_connect_timeout = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.include_service_catalog = True {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.insecure = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.interface = public {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.keyfile = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.memcache_password = **** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.memcache_username = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.region_name = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.service_token_roles_required = True {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.service_type = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.token_cache_time = 300 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.10/identity {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.backend = dogpile.cache.null {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.backend_argument = **** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.backend_expiration_time = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.config_prefix = cache.oslo {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.debug_cache_backend = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.enable_retry_client = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.enable_socket_keepalive = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.enabled = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.expiration_time = 600 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.hashclient_retry_attempts = 2 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76170]: INFO cinder.volume.manager [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.memcache_dead_retry = 300 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.memcache_pool_maxsize = 10 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.memcache_sasl_enabled = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.password = **** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.proxies = [] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.redis_db = 0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.redis_sentinel_service_name = mymaster {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.redis_server = localhost:6379 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.retry_attempts = 2 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.retry_delay = 0.0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.socket_keepalive_count = 1 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.socket_keepalive_idle = 1 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.socket_keepalive_interval = 1 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.socket_timeout = 1.0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.tls_allowed_ciphers = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.tls_cafile = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.tls_certfile = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.tls_enabled = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.tls_keyfile = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cache.username = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] coordination.backend_url = **** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.asyncio_connection = **** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.asyncio_slave_connection = **** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.backend = sqlalchemy {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.connection = **** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.connection_debug = 0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.connection_parameters = {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.connection_recycle_time = 3600 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.connection_trace = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.db_inc_retry_interval = True {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.db_max_retries = 20 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.db_max_retry_interval = 10 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.db_retry_interval = 1 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.max_overflow = 50 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.max_pool_size = 5 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.max_retries = 10 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.mysql_wsrep_sync_wait = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.pool_timeout = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.retry_interval = 10 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.slave_connection = **** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.sqlite_synchronous = True {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.synchronous_reader = True {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] database.use_db_reconnect = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_tracing.insecure = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] profiler.connection_string = messaging:// {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] profiler.enabled = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] profiler.es_doc_type = notification {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] profiler.es_scroll_size = 10000 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] profiler.es_scroll_time = 2m {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] profiler.filter_error_trace = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] profiler.hmac_keys = **** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] profiler.sentinel_service_name = mymaster {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] profiler.socket_timeout = 0.1 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] profiler.trace_requests = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] profiler.trace_sqlalchemy = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] profiler_jaeger.process_tags = {} {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] profiler_jaeger.service_name_prefix = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] profiler_otlp.service_name_prefix = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_policy.enforce_new_defaults = True {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_policy.policy_default_rule = default {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_policy.policy_file = policy.yaml {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_policy.remote_timeout = 60.0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] privsep_osbrick.group = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] privsep_osbrick.helper_command = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] privsep_osbrick.user = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cinder_sys_admin.group = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cinder_sys_admin.helper_command = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] cinder_sys_admin.user = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] service_user.auth_section = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] service_user.auth_type = password {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] service_user.cafile = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] service_user.certfile = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] service_user.collect_timing = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] service_user.insecure = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] service_user.keyfile = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] service_user.send_service_user_token = True {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] service_user.split_loggers = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] service_user.timeout = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] service_user.tls_ciphers = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] service_user.tls_min_version = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] glance.auth_section = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] glance.auth_type = password {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] glance.certfile = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] glance.collect_timing = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] glance.insecure = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] glance.keyfile = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] glance.region_name = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] glance.split_loggers = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] glance.timeout = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] glance.tls_ciphers = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] glance.tls_min_version = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.backend_availability_zone = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.chap_password = **** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.chap_username = {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.disk_geometry = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.driver_client_cert = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.driver_client_cert_key = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.driver_data_namespace = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.driver_use_ssl = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.enable_unsupported_driver = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.extra_capabilities = {} {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.filter_function = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.goodness_function = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.iscsi_target_flags = {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.iscsi_write_cache = on {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.iser_helper = tgtadm {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.iser_ip_address = 192.168.122.10 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.iser_port = 3260 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.049s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.lvm_mirrors = 0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.lvm_share_target = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.lvm_type = auto {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.num_shell_tries = 3 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.nvmet_port_id = 1 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.replication_device = **** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.report_discard_supported = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.reserved_percentage = 0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.scst_target_driver = iscsi {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.scst_target_iqn_name = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.storage_protocol = iSCSI {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.target_helper = tgtadm {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.target_ip_address = 192.168.122.10 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.target_port = 3260 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.target_protocol = iscsi {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.trace_flags = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.unique_fqdn_network = True {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.use_chap_auth = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.volume_backend_name = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.volume_clear = zero {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.volume_clear_ionice = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.volume_clear_size = 0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.volume_group = cinder-volumes {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_reports.file_event_handler = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_reports.log_dir = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.backend_availability_zone = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.backend_host = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.chap_password = **** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.chap_username = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.chiscsi_conf = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.disk_geometry = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.driver_client_cert = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.driver_data_namespace = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.driver_use_ssl = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.extra_capabilities = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.filter_function = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.goodness_function = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.iser_helper = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.iser_ip_address = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.iser_port = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.iser_target_prefix = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.lvm_conf_file = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.lvm_mirrors = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.lvm_share_target = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.lvm_type = auto {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.num_shell_tries = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.nvmet_port_id = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.replication_device = **** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.report_discard_supported = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.reserved_percentage = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.scst_target_driver = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack sudo[76180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.storage_protocol = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.target_helper = lioadm {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.target_ip_address = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.target_port = 3260 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.target_protocol = iscsi {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack sudo[76180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.trace_flags = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.use_chap_auth = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.volume_clear = zero {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.volume_clear_size = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] lvmdriver-1.volumes_dir = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.ssl = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.ssl_version = {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_notifications.driver = [] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_notifications.retry = -1 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] oslo_messaging_notifications.transport_url = **** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] key_manager.fixed_key = **** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican.barbican_api_version = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican.barbican_endpoint = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican.barbican_endpoint_type = public {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican.barbican_region_name = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican.cafile = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican.certfile = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican.collect_timing = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican.insecure = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican.keyfile = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican.number_of_retries = 60 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican.retry_delay = 1 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican.send_service_user_token = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican.split_loggers = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican.timeout = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican.tls_ciphers = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican.tls_min_version = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican.verify_ssl = True {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican.verify_ssl_path = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican_service_user.auth_section = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican_service_user.auth_type = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican_service_user.cafile = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican_service_user.certfile = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican_service_user.collect_timing = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican_service_user.insecure = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican_service_user.keyfile = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican_service_user.split_loggers = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican_service_user.timeout = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican_service_user.tls_ciphers = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] barbican_service_user.tls_min_version = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] vault.approle_role_id = **** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] vault.approle_secret_id = **** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] vault.auth_method = approle {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] vault.auth_path = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] vault.kv_mountpoint = secret {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] vault.kv_path = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] vault.kv_version = 2 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] vault.namespace = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] vault.root_token_id = **** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] vault.ssl_ca_crt_file = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] vault.timeout = 60.0 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] vault.token_file = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] vault.token_role = None {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] vault.use_ssl = False {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:58:05 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] ******************************************************************************** {{(pid=76012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 16:58:05 devstack sudo[76180]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:05 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:05 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:05 devstack sudo[76288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:58:05 devstack sudo[76288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:06 devstack sudo[76288]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:06 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.277s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:06 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:58:06 devstack cinder-volume[76170]: INFO cinder.brick.local_dev.lvm [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 25 16:58:06 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:06 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:06 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:06 devstack sudo[76407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:58:06 devstack sudo[76407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:06 devstack sudo[76407]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:06 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.303s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:06 devstack cinder-volume[76170]: DEBUG cinder.brick.local_dev.lvm [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76170) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 25 16:58:06 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:06 devstack sudo[76518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:58:06 devstack sudo[76518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:06 devstack sudo[76518]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:06 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.541s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:06 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:07 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:07 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:07 devstack sudo[76702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:58:07 devstack sudo[76702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:07 devstack sudo[76702]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:07 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.334s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:07 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:07 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:07 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:07 devstack sudo[76783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 25 16:58:07 devstack sudo[76783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:07 devstack sudo[76783]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:07 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.301s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:07 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:07 devstack sudo[76791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:58:07 devstack sudo[76791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:07 devstack sudo[76791]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:07 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.325s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:08 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:08 devstack sudo[76869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:58:08 devstack sudo[76869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:08 devstack sudo[76869]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:08 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:08 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:08 devstack sudo[76878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:58:08 devstack sudo[76878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:08 devstack sudo[76878]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:08 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.359s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:08 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:08 devstack sudo[76961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:58:08 devstack sudo[76961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:08 devstack sudo[76961]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:08 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.319s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:08 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:08 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:08 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:08 devstack sudo[76965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:58:08 devstack sudo[76965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:09 devstack sudo[76965]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:09 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.334s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:09 devstack cinder-volume[76170]: INFO cinder.volume.drivers.lvm [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 25 16:58:09 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:09 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:09 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:09 devstack sudo[76975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:58:09 devstack sudo[76975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:09 devstack sudo[76975]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:09 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.295s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:09 devstack cinder-volume[76170]: DEBUG cinder.volume.drivers.lvm [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Updating volume stats {{(pid=76170) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 16:58:09 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:09 devstack sudo[76978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:58:09 devstack sudo[76978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:09 devstack sudo[76978]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:09 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:09 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:09 devstack sudo[76981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:58:09 devstack sudo[76981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:10 devstack sudo[76981]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:10 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:10 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:10 devstack sudo[76984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:58:10 devstack sudo[76984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:10 devstack sudo[76984]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:10 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:10 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:10 devstack sudo[76988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:58:10 devstack sudo[76988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:10 devstack sudo[76988]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:10 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:10 devstack cinder-volume[76170]: INFO cinder.volume.driver [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Driver hasn't implemented _init_vendor_properties() Sep 25 16:58:10 devstack cinder-volume[76170]: DEBUG cinder.volume.driver [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76170) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 16:58:10 devstack cinder-volume[76170]: DEBUG oslo_db.sqlalchemy.engines [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76170) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:58:10 devstack cinder-volume[76170]: DEBUG dbcounter [-] [76170] Writer thread running {{(pid=76170) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 16:58:10 devstack cinder-volume[76170]: DEBUG cinder.db.api [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Building query based on filter {{(pid=76170) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 16:58:10 devstack cinder-volume[76170]: DEBUG cinder.image.image_utils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76170) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 16:58:10 devstack cinder-volume[76170]: INFO cinder.keymgr.migration [None req-96a5c66d-7291-4771-bab8-217a5dd11d53 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 16:58:10 devstack cinder-volume[76170]: DEBUG cinder.volume.drivers.lvm [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Updating volume stats {{(pid=76170) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 16:58:10 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:10 devstack sudo[76993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:58:10 devstack sudo[76993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:11 devstack sudo[76993]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:11 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:11 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:11 devstack sudo[76996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:58:11 devstack sudo[76996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:11 devstack sudo[76996]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:11 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:11 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:11 devstack sudo[76999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:58:11 devstack sudo[76999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:11 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:11 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:11 devstack sudo[76999]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:11 devstack sudo[77002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:58:11 devstack sudo[77002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:12 devstack sudo[77002]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:12 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:12 devstack cinder-volume[76170]: DEBUG cinder.manager [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Notifying Schedulers of capabilities ... {{(pid=76170) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:58:12 devstack cinder-volume[76170]: INFO cinder.volume.manager [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Driver initialization completed successfully. Sep 25 16:58:12 devstack cinder-volume[76170]: INFO cinder.manager [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Initiating service 2 cleanup Sep 25 16:58:12 devstack cinder-volume[76170]: INFO cinder.manager [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Service 2 cleanup completed. Sep 25 16:58:12 devstack cinder-volume[76170]: DEBUG cinder.service [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Creating RPC server for service cinder-volume {{(pid=76170) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 16:58:12 devstack cinder-volume[76170]: DEBUG cinder.service [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76170) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 16:58:12 devstack cinder-volume[76170]: INFO cinder.volume.manager [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 25 16:58:12 devstack cinder-volume[76170]: DEBUG cinder.volume.drivers.lvm [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Updating volume stats {{(pid=76170) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 16:58:12 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:12 devstack sudo[77007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:58:12 devstack sudo[77007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:12 devstack sudo[77007]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:12 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:12 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:12 devstack sudo[77013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:58:12 devstack sudo[77013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:12 devstack sudo[77013]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:12 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:12 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:12 devstack sudo[77016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:58:12 devstack sudo[77016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:13 devstack sudo[77016]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:13 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:13 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:13 devstack sudo[77019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:58:13 devstack sudo[77019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:13 devstack sudo[77019]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:13 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:13 devstack cinder-volume[76170]: INFO cinder.volume.manager [None req-2ecb3a42-d859-4f35-bac4-f2a38fdb8dae None None] Driver post RPC initialization completed successfully. Sep 25 16:58:15 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:58:22 devstack cinder-volume[76170]: DEBUG dbcounter [-] [76170] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76170) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:58:23 devstack cinder-volume[76170]: DEBUG dbcounter [-] [76170] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76170) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:58:56 devstack cinder-volume[76170]: DEBUG oslo_service.periodic_task [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Running periodic task VolumeManager._thread_info {{(pid=76170) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:58:56 devstack cinder-volume[76170]: DEBUG cinder.volume.manager [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] thread count: 6 {{(pid=76170) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:58:56 devstack cinder-volume[76170]: DEBUG cinder.volume.manager [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] thread info: [<_MainThread(MainThread, started 126531488034944)>, , , , , ] {{(pid=76170) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:59:56 devstack cinder-volume[76170]: DEBUG oslo_service.periodic_task [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76170) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:59:56 devstack cinder-volume[76170]: DEBUG cinder.volume.drivers.lvm [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Updating volume stats {{(pid=76170) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 16:59:56 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:59:56 devstack sudo[82244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:59:56 devstack sudo[82244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:59:56 devstack sudo[82244]: pam_unix(sudo:session): session closed for user root Sep 25 16:59:56 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:59:56 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:59:56 devstack sudo[82247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:59:56 devstack sudo[82247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:59:56 devstack sudo[82247]: pam_unix(sudo:session): session closed for user root Sep 25 16:59:56 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:59:56 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:59:56 devstack sudo[82250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:59:56 devstack sudo[82250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:59:57 devstack sudo[82250]: pam_unix(sudo:session): session closed for user root Sep 25 16:59:57 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:59:57 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:59:57 devstack sudo[82253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:59:57 devstack sudo[82253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:59:57 devstack sudo[82253]: pam_unix(sudo:session): session closed for user root Sep 25 16:59:57 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:59:57 devstack cinder-volume[76170]: DEBUG cinder.manager [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Notifying Schedulers of capabilities ... {{(pid=76170) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:59:57 devstack cinder-volume[76170]: DEBUG oslo_service.periodic_task [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Running periodic task VolumeManager._thread_info {{(pid=76170) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:59:57 devstack cinder-volume[76170]: DEBUG cinder.volume.manager [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] thread count: 6 {{(pid=76170) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:59:57 devstack cinder-volume[76170]: DEBUG cinder.volume.manager [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] thread info: [<_MainThread(MainThread, started 126531488034944)>, , , , , ] {{(pid=76170) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:00:23 devstack cinder-volume[76170]: DEBUG dbcounter [-] [76170] Writing DB stats cinder:SELECT=1 {{(pid=76170) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:00:23 devstack cinder-volume[76170]: DEBUG dbcounter [-] [76170] Writing DB stats cinder:UPDATE=1 {{(pid=76170) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:00:56 devstack cinder-volume[76170]: DEBUG oslo_service.periodic_task [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76170) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:00:56 devstack cinder-volume[76170]: DEBUG cinder.volume.drivers.lvm [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Updating volume stats {{(pid=76170) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 17:00:56 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:00:56 devstack sudo[83883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 17:00:56 devstack sudo[83883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:00:56 devstack sudo[83883]: pam_unix(sudo:session): session closed for user root Sep 25 17:00:56 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:00:56 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:00:56 devstack sudo[83899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 17:00:56 devstack sudo[83899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:00:56 devstack sudo[83899]: pam_unix(sudo:session): session closed for user root Sep 25 17:00:56 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:00:56 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:00:56 devstack sudo[83916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 17:00:56 devstack sudo[83916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:00:57 devstack sudo[83916]: pam_unix(sudo:session): session closed for user root Sep 25 17:00:57 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:00:57 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:00:57 devstack sudo[83921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 17:00:57 devstack sudo[83921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:00:57 devstack sudo[83921]: pam_unix(sudo:session): session closed for user root Sep 25 17:00:57 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:00:57 devstack cinder-volume[76170]: DEBUG cinder.manager [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Notifying Schedulers of capabilities ... {{(pid=76170) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:00:57 devstack cinder-volume[76170]: DEBUG oslo_service.periodic_task [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Running periodic task VolumeManager._thread_info {{(pid=76170) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:00:57 devstack cinder-volume[76170]: DEBUG cinder.volume.manager [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] thread count: 6 {{(pid=76170) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:00:57 devstack cinder-volume[76170]: DEBUG cinder.volume.manager [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] thread info: [<_MainThread(MainThread, started 126531488034944)>, , , , , ] {{(pid=76170) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:01:56 devstack cinder-volume[76170]: DEBUG oslo_service.periodic_task [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76170) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:01:56 devstack cinder-volume[76170]: DEBUG cinder.volume.drivers.lvm [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Updating volume stats {{(pid=76170) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 17:01:56 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:01:56 devstack sudo[85277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 17:01:56 devstack sudo[85277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:01:56 devstack sudo[85277]: pam_unix(sudo:session): session closed for user root Sep 25 17:01:56 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:01:56 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:01:56 devstack sudo[85280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 17:01:56 devstack sudo[85280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:01:56 devstack sudo[85280]: pam_unix(sudo:session): session closed for user root Sep 25 17:01:56 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:01:56 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:01:56 devstack sudo[85284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 17:01:56 devstack sudo[85284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:01:57 devstack sudo[85284]: pam_unix(sudo:session): session closed for user root Sep 25 17:01:57 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:01:57 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:01:57 devstack sudo[85287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 17:01:57 devstack sudo[85287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:01:57 devstack sudo[85287]: pam_unix(sudo:session): session closed for user root Sep 25 17:01:57 devstack cinder-volume[76170]: DEBUG oslo_concurrency.processutils [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:01:57 devstack cinder-volume[76170]: DEBUG cinder.manager [None req-e59add5b-029d-4ddf-9738-a57699e73e85 None None] Notifying Schedulers of capabilities ... {{(pid=76170) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:02:23 devstack cinder-volume[76170]: DEBUG dbcounter [-] [76170] Writing DB stats cinder:SELECT=1 {{(pid=76170) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:02:23 devstack cinder-volume[76170]: DEBUG dbcounter [-] [76170] Writing DB stats cinder:UPDATE=1 {{(pid=76170) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:02:39 devstack cinder-volume[76012]: INFO oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Caught SIGTERM, stopping children Sep 25 17:02:39 devstack cinder-volume[76012]: DEBUG oslo_concurrency.lockutils [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Acquiring lock "singleton_lock" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 17:02:39 devstack cinder-volume[76012]: DEBUG oslo_concurrency.lockutils [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Acquired lock "singleton_lock" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 17:02:39 devstack cinder-volume[76012]: DEBUG oslo_concurrency.lockutils [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Releasing lock "singleton_lock" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 17:02:39 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Stop services. {{(pid=76012) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 17:02:39 devstack cinder-volume[76012]: DEBUG oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Killing children. {{(pid=76012) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 17:02:39 devstack cinder-volume[76012]: INFO oslo_service.backend._eventlet.service [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Waiting on 1 children to exit Sep 25 17:02:44 devstack cinder-volume[76170]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 25 17:02:44 devstack cinder-volume[86187]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 17:02:44 devstack cinder-volume[86187]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 17:02:44 devstack cinder-volume[86187]: we strongly recommend against using it for new projects. Sep 25 17:02:44 devstack cinder-volume[86187]: If you are already using Eventlet, we recommend migrating to a different Sep 25 17:02:44 devstack cinder-volume[86187]: framework. For more detail see Sep 25 17:02:44 devstack cinder-volume[86187]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 17:02:44 devstack cinder-volume[86187]: import eventlet # noqa Sep 25 17:02:46 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86187) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 17:02:46 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86187) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 17:02:46 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86187) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 17:02:47 devstack cinder-volume[86187]: INFO dbcounter [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Registered counter for database cinder Sep 25 17:02:47 devstack cinder-volume[76170]: DEBUG oslo_concurrency.lockutils [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Acquiring lock "singleton_lock" {{(pid=76170) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 17:02:47 devstack cinder-volume[76170]: DEBUG oslo_concurrency.lockutils [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Acquired lock "singleton_lock" {{(pid=76170) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 17:02:47 devstack cinder-volume[76170]: DEBUG oslo_concurrency.lockutils [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Releasing lock "singleton_lock" {{(pid=76170) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 17:02:47 devstack cinder-volume[76170]: WARNING amqp [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 17:02:47 devstack cinder-volume[86187]: DEBUG oslo_db.sqlalchemy.engines [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86187) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:02:47 devstack cinder-volume[76170]: WARNING amqp [None req-d11101c3-9cfe-48c8-932f-6f3c11b59c2d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 17:02:47 devstack cinder-volume[86187]: DEBUG dbcounter [-] [86187] Writer thread running {{(pid=86187) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 17:02:47 devstack cinder-volume[86187]: INFO cinder.rpc [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 17:02:47 devstack cinder-volume[86187]: INFO cinder.rpc [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 17:02:47 devstack cinder-volume[86187]: DEBUG oslo_db.sqlalchemy.engines [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86187) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:02:47 devstack cinder-volume[86187]: INFO cinder.volume.manager [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Determined volume DB was empty at startup. Sep 25 17:02:47 devstack cinder-volume[86187]: DEBUG cinder.volume.manager [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86187) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 17:02:47 devstack cinder-volume[86187]: INFO cinder.volume.manager [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 17:02:47 devstack cinder-volume[86187]: WARNING stevedore.named [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 17:02:47 devstack cinder-volume[86187]: WARNING castellan.key_manager [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 17:02:47 devstack cinder-volume[86187]: WARNING cinder.keymgr.conf_key_mgr [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 17:02:47 devstack cinder-volume[86187]: INFO cinder.volume.manager [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_db.sqlalchemy.engines [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86187) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:02:48 devstack cinder-volume[86187]: INFO oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Starting 1 workers Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Started child 86412 {{(pid=86187) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Full set of CONF: {{(pid=86187) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] ******************************************************************************** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Configuration options gathered from: {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] ================================================================================ {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] allow_availability_zone_fallback = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] allow_compression_on_image_upload = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] allowed_direct_url_schemes = [] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] api_rate_limit = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] auth_strategy = keystone {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_availability_zone = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_host = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_name = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_stats_polling_interval = 60 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backup_api_class = cinder.backup.api.API {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backup_name_template = backup-%s {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backup_use_same_host = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backup_use_temp_snapshot = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] chap_password = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] chap_username = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cinder_internal_tenant_project_id = 4cfe38f4207b4355a02d50dfd78b03c4 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cinder_internal_tenant_user_id = fa1640b086b44255a45bcfc0228e221c {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cluster = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] compression_format = gzip {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] compute_api_class = cinder.compute.nova.API {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] config_dir = [] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] config_source = [] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] control_exchange = openstack {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] debug = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] default_availability_zone = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] default_group_type = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] default_volume_type = QuobyteHD {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] disk_geometry = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] driver_client_cert = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] driver_client_cert_key = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86412]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] driver_data_namespace = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] driver_ssl_cert_path = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] driver_ssl_cert_verify = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] driver_use_ssl = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] enable_new_services = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] enable_unsupported_driver = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] enabled_backends = ['QuobyteHD'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] enforce_multipath_for_image_xfer = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] filter_function = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] glance_api_insecure = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] glance_api_servers = ['http://192.168.122.10/image'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] glance_api_ssl_compression = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] glance_ca_certificates_file = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] glance_catalog_info = image:glance:publicURL {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] glance_certfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] glance_keyfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] glance_num_retries = 3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] glance_request_timeout = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] goodness_function = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] graceful_shutdown_timeout = 5 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] group_api_class = cinder.group.api.API {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] host = devstack {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] image_compress_on_upload = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] image_conversion_address_space_limit = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] image_conversion_cpu_limit = 60 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] image_conversion_disable = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] image_introspection_address_space_limit = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] image_introspection_cpu_limit = 60 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] image_upload_use_cinder_backend = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] image_upload_use_internal_tenant = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] image_volume_cache_enabled = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] image_volume_cache_max_count = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] image_volume_cache_max_size_gb = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] init_host_max_objects_retrieval = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] instance_format = [instance: %(uuid)s] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] iscsi_target_flags = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] iscsi_write_cache = on {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] iser_helper = tgtadm {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] iser_ip_address = 192.168.122.10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] iser_port = 3260 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] log_color = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] log_config_append = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] log_dir = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] log_file = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] log_options = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] log_rotate_interval = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] log_rotate_interval_type = days {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] log_rotation_type = none {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] max_age = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] max_logfile_count = 30 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] max_logfile_size_mb = 200 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] max_over_subscription_ratio = 20.0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] message_reap_interval = 86400 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] message_ttl = 2592000 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] migration_create_volume_timeout_secs = 300 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] monkey_patch = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] monkey_patch_modules = [] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] my_ip = 192.168.122.10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] no_snapshot_gb_quota = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] num_iser_scan_tries = 3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] num_shell_tries = 3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] num_volume_device_scan_tries = 3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] nvmeof_conn_info_version = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] nvmet_ns_id = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] nvmet_port_id = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] osapi_max_limit = 1000 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] osapi_volume_ext_list = [] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] osapi_volume_listen = 0.0.0.0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] osapi_volume_listen_port = 8776 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] osapi_volume_use_ssl = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] osapi_volume_workers = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] per_volume_size_limit = -1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] periodic_fuzzy_delay = 60 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] periodic_interval = 60 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] project_id_regex = [0-9a-f\-]+ {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] public_endpoint = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] publish_errors = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] quota_backup_gigabytes = 1000 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] quota_backups = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] quota_gigabytes = 1000 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] quota_groups = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] quota_snapshots = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] quota_volumes = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] rate_limit_burst = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] rate_limit_except_level = CRITICAL {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] rate_limit_interval = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] reinit_driver_count = 3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] replication_device = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] report_discard_supported = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] report_interval = 120 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] reservation_clean_interval = 86400 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] reservation_expire = 86400 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] reserved_image_namespaces = [] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] reserved_percentage = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] rpc_response_timeout = 120 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] run_external_periodic_tasks = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] scst_target_driver = iscsi {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] scst_target_iqn_name = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] service_down_time = 720 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] shell_completion = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] snapshot_name_template = snapshot-%s {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] split_loggers = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] state_path = /opt/stack/data/cinder {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] storage_availability_zone = nova {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] storage_protocol = iSCSI {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] syslog_log_facility = LOG_USER {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] target_helper = lioadm {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] target_ip_address = 192.168.122.10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] target_port = 3260 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] target_protocol = iscsi {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] target_secondary_ip_addresses = [] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] trace_flags = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] transfer_api_class = cinder.transfer.api.API {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] transport_url = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] until_refresh = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] use_chap_auth = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] use_default_quota_class = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] use_journal = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] use_json = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] use_multipath_for_image_xfer = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] use_stderr = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] use_syslog = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] verify_glance_signatures = enabled {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] volume_api_class = cinder.volume.api.API {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] volume_backend_name = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] volume_clear = zero {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] volume_clear_ionice = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] volume_clear_size = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] volume_copy_bps_limit = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] volume_dd_blocksize = 1M {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] volume_name_template = volume-%s {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] volume_service_inithost_offload = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] volume_usage_audit_period = month {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] zoning_mode = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_concurrency.disable_process_locking = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.auth_section = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.auth_type = password {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.auth_version = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.cache = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.certfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.delay_auth_decision = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.http_connect_timeout = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.include_service_catalog = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.insecure = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.interface = public {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.keyfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.memcache_password = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.memcache_username = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.region_name = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.service_token_roles_required = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.service_type = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.token_cache_time = 300 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.10/identity {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.backend = dogpile.cache.null {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.backend_argument = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.backend_expiration_time = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.config_prefix = cache.oslo {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.debug_cache_backend = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86412]: INFO cinder.volume.manager [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.enable_retry_client = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.enable_socket_keepalive = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.enabled = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.expiration_time = 600 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.hashclient_retry_attempts = 2 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.memcache_dead_retry = 300 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.memcache_pool_maxsize = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.memcache_sasl_enabled = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.password = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.proxies = [] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.redis_db = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.redis_sentinel_service_name = mymaster {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86412]: DEBUG cinder.volume.drivers.remotefs [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86412) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.redis_server = localhost:6379 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.retry_attempts = 2 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.retry_delay = 0.0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.socket_keepalive_count = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.socket_keepalive_idle = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.socket_keepalive_interval = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.socket_timeout = 1.0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.tls_allowed_ciphers = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.tls_cafile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.tls_certfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.tls_enabled = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.tls_keyfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cache.username = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] coordination.backend_url = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.asyncio_connection = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.asyncio_slave_connection = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.backend = sqlalchemy {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.connection = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.connection_debug = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.connection_parameters = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.connection_recycle_time = 3600 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.connection_trace = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.db_inc_retry_interval = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.db_max_retries = 20 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.db_max_retry_interval = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.db_retry_interval = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.max_overflow = 50 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.max_pool_size = 5 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.max_retries = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.mysql_wsrep_sync_wait = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.pool_timeout = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.retry_interval = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.slave_connection = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.sqlite_synchronous = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.synchronous_reader = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] database.use_db_reconnect = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_tracing.insecure = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] profiler.connection_string = messaging:// {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] profiler.enabled = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] profiler.es_doc_type = notification {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] profiler.es_scroll_size = 10000 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] profiler.es_scroll_time = 2m {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] profiler.filter_error_trace = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] profiler.hmac_keys = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] profiler.sentinel_service_name = mymaster {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] profiler.socket_timeout = 0.1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] profiler.trace_requests = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] profiler.trace_sqlalchemy = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] profiler_jaeger.process_tags = {} {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] profiler_jaeger.service_name_prefix = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] profiler_otlp.service_name_prefix = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_policy.enforce_new_defaults = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_policy.policy_default_rule = default {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_policy.policy_file = policy.yaml {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_policy.remote_timeout = 60.0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] privsep_osbrick.group = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] privsep_osbrick.helper_command = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] privsep_osbrick.user = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cinder_sys_admin.group = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cinder_sys_admin.helper_command = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] cinder_sys_admin.user = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] service_user.auth_section = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] service_user.auth_type = password {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] service_user.cafile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] service_user.certfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] service_user.collect_timing = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] service_user.insecure = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] service_user.keyfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] service_user.send_service_user_token = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] service_user.split_loggers = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] service_user.timeout = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] service_user.tls_ciphers = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] service_user.tls_min_version = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] glance.auth_section = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] glance.auth_type = password {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] glance.certfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] glance.collect_timing = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] glance.insecure = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] glance.keyfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] glance.region_name = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] glance.split_loggers = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] glance.timeout = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] glance.tls_ciphers = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] glance.tls_min_version = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.backend_availability_zone = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.chap_password = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.chap_username = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.disk_geometry = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.driver_client_cert = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.driver_client_cert_key = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.driver_data_namespace = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.driver_use_ssl = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.enable_unsupported_driver = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.extra_capabilities = {} {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.filter_function = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.goodness_function = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.iscsi_target_flags = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.iscsi_write_cache = on {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.iser_helper = tgtadm {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.iser_ip_address = 192.168.122.10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.iser_port = 3260 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.nas_host = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.nas_login = admin {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.nas_mount_options = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.nas_password = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.nas_private_key = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.nas_share_path = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.nas_ssh_port = 22 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.num_shell_tries = 3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.nvmet_port_id = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.quobyte_client_cfg = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.quobyte_volume_url = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.replication_device = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.report_discard_supported = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.reserved_percentage = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.scst_target_driver = iscsi {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.scst_target_iqn_name = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.storage_protocol = iSCSI {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.target_helper = tgtadm {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.target_ip_address = 192.168.122.10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.target_port = 3260 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.target_protocol = iscsi {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.trace_flags = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.unique_fqdn_network = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.use_chap_auth = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.volume_backend_name = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.volume_clear = zero {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.volume_clear_ionice = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.volume_clear_size = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_reports.file_event_handler = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_reports.log_dir = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.backend_availability_zone = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.backend_host = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.chap_password = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.chap_username = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.chiscsi_conf = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.disk_geometry = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.driver_client_cert = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.driver_client_cert_key = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.driver_data_namespace = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.driver_use_ssl = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.extra_capabilities = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.filter_function = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.goodness_function = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.iscsi_target_flags = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.iscsi_write_cache = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.iser_helper = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.iser_ip_address = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.iser_port = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.iser_target_prefix = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.nas_host = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.nas_login = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.nas_mount_options = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.nas_password = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.nas_private_key = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.nas_share_path = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.nas_ssh_port = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.num_shell_tries = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.nvmet_ns_id = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.nvmet_port_id = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.replication_device = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.report_discard_supported = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.reserved_percentage = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.scst_target_driver = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.storage_protocol = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.target_helper = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.target_ip_address = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.target_port = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.target_prefix = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.target_protocol = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.trace_flags = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.unique_fqdn_network = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.use_chap_auth = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.volume_clear = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.volume_clear_ionice = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.volume_clear_size = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] QuobyteHD.volumes_dir = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.ssl = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.ssl_version = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_notifications.driver = [] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_notifications.retry = -1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] oslo_messaging_notifications.transport_url = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] key_manager.fixed_key = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican.barbican_api_version = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican.barbican_endpoint = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican.barbican_endpoint_type = public {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican.barbican_region_name = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican.cafile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican.certfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican.collect_timing = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican.insecure = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican.keyfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican.number_of_retries = 60 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican.retry_delay = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican.send_service_user_token = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican.split_loggers = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican.timeout = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican.tls_ciphers = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican.tls_min_version = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican.verify_ssl = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican.verify_ssl_path = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican_service_user.auth_section = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican_service_user.auth_type = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican_service_user.cafile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican_service_user.certfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican_service_user.collect_timing = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican_service_user.insecure = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican_service_user.keyfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican_service_user.split_loggers = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican_service_user.timeout = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican_service_user.tls_ciphers = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] barbican_service_user.tls_min_version = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] vault.approle_role_id = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] vault.approle_secret_id = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] vault.auth_method = approle {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] vault.auth_path = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] vault.kv_mountpoint = secret {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] vault.kv_path = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] vault.kv_version = 2 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] vault.namespace = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] vault.root_token_id = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] vault.ssl_ca_crt_file = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] vault.timeout = 60.0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] vault.token_file = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] vault.token_role = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] vault.use_ssl = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:02:48 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] ******************************************************************************** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 17:02:48 devstack cinder-volume[86412]: DEBUG cinder.volume.drivers.quobyte [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86412) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 17:02:48 devstack cinder-volume[86412]: WARNING cinder.volume.drivers.quobyte [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 17:02:48 devstack cinder-volume[86412]: WARNING cinder.volume.drivers.quobyte [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 17:02:48 devstack cinder-volume[86412]: DEBUG oslo_concurrency.processutils [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Running cmd (subprocess): mount.quobyte {{(pid=86412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:02:48 devstack quobyte-client[86421]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 17:02:48 devstack quobyte-client[86421]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 17:02:48 devstack cinder-volume[86412]: DEBUG oslo_concurrency.processutils [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] CMD "mount.quobyte" returned: 1 in 0.147s {{(pid=86412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:02:48 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86412) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:02:48 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86412) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:02:48 devstack cinder-volume[86412]: DEBUG cinder.volume.drivers.quobyte [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=86412) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:02:48 devstack cinder-volume[86412]: INFO cinder.volume.drivers.quobyte [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 ... Sep 25 17:02:48 devstack cinder-volume[86412]: DEBUG oslo_concurrency.processutils [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 -c /etc/quobyte/client-cinder.cfg {{(pid=86412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:02:48 devstack sudo[86428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 -c /etc/quobyte/client-cinder.cfg Sep 25 17:02:48 devstack sudo[86428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:02:48 devstack sudo[86428]: pam_unix(sudo:session): session closed for user root Sep 25 17:02:48 devstack cinder-volume[86412]: DEBUG oslo_concurrency.processutils [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.403s {{(pid=86412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:02:48 devstack cinder-volume[86412]: INFO cinder.volume.drivers.quobyte [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 succeeded Sep 25 17:02:48 devstack cinder-volume[86412]: DEBUG cinder.volume.drivers.quobyte [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=86412) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.416s {{(pid=86412) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG oslo_concurrency.processutils [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=86412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:02:49 devstack sudo[86535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:02:49 devstack sudo[86535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:02:49 devstack sudo[86535]: pam_unix(sudo:session): session closed for user root Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG oslo_concurrency.processutils [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.253s {{(pid=86412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:02:49 devstack cinder-volume[86412]: INFO cinder.volume.driver [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Driver hasn't implemented _init_vendor_properties() Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG cinder.volume.driver [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.302547454834, 'free_capacity_gb': 1775.302547454834, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86412) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG oslo_db.sqlalchemy.engines [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG dbcounter [-] [86412] Writer thread running {{(pid=86412) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG cinder.db.api [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Building query based on filter {{(pid=86412) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG cinder.image.image_utils [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86412) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 17:02:49 devstack cinder-volume[86412]: INFO cinder.keymgr.migration [None req-1034670f-cd7b-414d-981a-230fc3b92fd3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86412) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86412) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG cinder.volume.drivers.quobyte [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=86412) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG cinder.volume.drivers.quobyte [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=86412) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86412) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG oslo_concurrency.processutils [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=86412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:02:49 devstack sudo[86540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:02:49 devstack sudo[86540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:02:49 devstack sudo[86540]: pam_unix(sudo:session): session closed for user root Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG oslo_concurrency.processutils [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.245s {{(pid=86412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG cinder.manager [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Notifying Schedulers of capabilities ... {{(pid=86412) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:02:49 devstack cinder-volume[86412]: INFO cinder.volume.manager [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Driver initialization completed successfully. Sep 25 17:02:49 devstack cinder-volume[86412]: INFO cinder.manager [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Initiating service 3 cleanup Sep 25 17:02:49 devstack cinder-volume[86412]: INFO cinder.manager [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Service 3 cleanup completed. Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG cinder.service [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Creating RPC server for service cinder-volume {{(pid=86412) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG cinder.service [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86412) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 17:02:49 devstack cinder-volume[86412]: INFO cinder.volume.manager [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86412) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86412) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG cinder.volume.drivers.quobyte [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=86412) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG cinder.volume.drivers.quobyte [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=86412) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86412) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:02:49 devstack cinder-volume[86412]: DEBUG oslo_concurrency.processutils [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=86412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:02:49 devstack sudo[86549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:02:49 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:02:50 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root Sep 25 17:02:50 devstack cinder-volume[86412]: DEBUG oslo_concurrency.processutils [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.288s {{(pid=86412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:02:50 devstack cinder-volume[86412]: INFO cinder.volume.manager [None req-2c8f5e9e-8c98-4fb8-a7e9-5bad96c45686 None None] Driver post RPC initialization completed successfully. Sep 25 17:02:54 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-cdf63b9b-68c0-4117-bd2e-99fa8d9e0705 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86412) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:02:54 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-cdf63b9b-68c0-4117-bd2e-99fa8d9e0705 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86412) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:02:54 devstack cinder-volume[86412]: DEBUG cinder.volume.drivers.quobyte [None req-cdf63b9b-68c0-4117-bd2e-99fa8d9e0705 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=86412) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:02:54 devstack cinder-volume[86412]: DEBUG cinder.volume.drivers.quobyte [None req-cdf63b9b-68c0-4117-bd2e-99fa8d9e0705 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=86412) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:02:54 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-cdf63b9b-68c0-4117-bd2e-99fa8d9e0705 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86412) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:02:54 devstack cinder-volume[86412]: DEBUG oslo_concurrency.processutils [None req-cdf63b9b-68c0-4117-bd2e-99fa8d9e0705 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=86412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:02:54 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:02:54 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:02:54 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Sep 25 17:02:54 devstack cinder-volume[86412]: DEBUG oslo_concurrency.processutils [None req-cdf63b9b-68c0-4117-bd2e-99fa8d9e0705 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.240s {{(pid=86412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:02:54 devstack cinder-volume[86412]: DEBUG cinder.manager [None req-cdf63b9b-68c0-4117-bd2e-99fa8d9e0705 None None] Notifying Schedulers of capabilities ... {{(pid=86412) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:02:56 devstack cinder-volume[86187]: INFO oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Caught SIGTERM, stopping children Sep 25 17:02:56 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Acquiring lock "singleton_lock" {{(pid=86187) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 17:02:56 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Acquired lock "singleton_lock" {{(pid=86187) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 17:02:56 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Releasing lock "singleton_lock" {{(pid=86187) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 17:02:56 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Stop services. {{(pid=86187) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 17:02:56 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Killing children. {{(pid=86187) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 17:02:56 devstack cinder-volume[86187]: INFO oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Waiting on 1 children to exit Sep 25 17:02:58 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Acquiring lock "singleton_lock" {{(pid=86412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 17:02:58 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Acquired lock "singleton_lock" {{(pid=86412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 17:02:58 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Releasing lock "singleton_lock" {{(pid=86412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 17:02:58 devstack cinder-volume[86412]: WARNING amqp [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 17:02:58 devstack cinder-volume[86412]: WARNING amqp [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 17:02:58 devstack cinder-volume[86187]: INFO oslo_service.backend._eventlet.service [None req-f35df7f1-56c4-4167-b26f-af18fbd7c5aa None None] Child 86412 exited with status 0 Sep 25 17:02:58 devstack cinder-volume[86884]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 17:02:58 devstack cinder-volume[86884]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 17:02:58 devstack cinder-volume[86884]: we strongly recommend against using it for new projects. Sep 25 17:02:58 devstack cinder-volume[86884]: If you are already using Eventlet, we recommend migrating to a different Sep 25 17:02:58 devstack cinder-volume[86884]: framework. For more detail see Sep 25 17:02:58 devstack cinder-volume[86884]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 17:02:58 devstack cinder-volume[86884]: import eventlet # noqa Sep 25 17:03:02 devstack cinder-volume[86884]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86884) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 17:03:02 devstack cinder-volume[86884]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86884) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 17:03:02 devstack cinder-volume[86884]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86884) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 17:03:04 devstack cinder-volume[86884]: INFO dbcounter [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] Registered counter for database cinder Sep 25 17:03:04 devstack cinder-volume[86884]: DEBUG oslo_db.sqlalchemy.engines [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86884) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG dbcounter [-] [86884] Writer thread running {{(pid=86884) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 17:03:05 devstack cinder-volume[86884]: INFO cinder.rpc [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 17:03:05 devstack cinder-volume[86884]: INFO cinder.rpc [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_db.sqlalchemy.engines [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86884) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:03:05 devstack cinder-volume[86884]: INFO cinder.volume.manager [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] Determined volume DB was empty at startup. Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG cinder.volume.manager [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86884) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 17:03:05 devstack cinder-volume[86884]: WARNING stevedore.named [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 17:03:05 devstack cinder-volume[86884]: WARNING castellan.key_manager [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 17:03:05 devstack cinder-volume[86884]: WARNING cinder.keymgr.conf_key_mgr [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 17:03:05 devstack cinder-volume[86884]: INFO cinder.volume.manager [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_db.sqlalchemy.engines [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86884) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:03:05 devstack cinder-volume[86884]: INFO oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] Starting 1 workers Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] Started child 87211 {{(pid=86884) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] Full set of CONF: {{(pid=86884) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] ******************************************************************************** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] Configuration options gathered from: {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] ================================================================================ {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] allow_availability_zone_fallback = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] allow_compression_on_image_upload = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] allowed_direct_url_schemes = [] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[87211]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] api_rate_limit = True {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] auth_strategy = keystone {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_availability_zone = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_host = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_name = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_stats_polling_interval = 60 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backup_api_class = cinder.backup.api.API {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backup_name_template = backup-%s {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backup_use_same_host = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backup_use_temp_snapshot = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] chap_password = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] chap_username = {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cinder_internal_tenant_project_id = 4cfe38f4207b4355a02d50dfd78b03c4 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cinder_internal_tenant_user_id = fa1640b086b44255a45bcfc0228e221c {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cluster = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] compression_format = gzip {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] compute_api_class = cinder.compute.nova.API {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] config_dir = [] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] config_source = [] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] control_exchange = openstack {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] debug = True {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] default_availability_zone = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] default_group_type = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] default_volume_type = QuobyteHD {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] disk_geometry = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] driver_client_cert = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] driver_client_cert_key = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] driver_data_namespace = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] driver_ssl_cert_path = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] driver_ssl_cert_verify = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] driver_use_ssl = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] enable_new_services = True {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] enable_unsupported_driver = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] enabled_backends = ['QuobyteHD'] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] enforce_multipath_for_image_xfer = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] filter_function = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] glance_api_insecure = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] glance_api_servers = ['http://192.168.122.10/image'] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] glance_api_ssl_compression = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] glance_ca_certificates_file = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] glance_catalog_info = image:glance:publicURL {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] glance_certfile = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] glance_keyfile = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87211) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] glance_num_retries = 3 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] glance_request_timeout = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] goodness_function = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] graceful_shutdown_timeout = 5 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] group_api_class = cinder.group.api.API {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] host = devstack {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] image_compress_on_upload = True {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] image_conversion_address_space_limit = 1 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] image_conversion_cpu_limit = 60 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] image_conversion_disable = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] image_introspection_address_space_limit = 1 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] image_introspection_cpu_limit = 60 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] image_upload_use_cinder_backend = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] image_upload_use_internal_tenant = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] image_volume_cache_enabled = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] image_volume_cache_max_count = 0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] image_volume_cache_max_size_gb = 0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] init_host_max_objects_retrieval = 0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] instance_format = [instance: %(uuid)s] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] iscsi_target_flags = {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] iscsi_write_cache = on {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] iser_helper = tgtadm {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] iser_ip_address = 192.168.122.10 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] iser_port = 3260 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] log_color = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] log_config_append = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] log_dir = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] log_file = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] log_options = True {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] log_rotate_interval = 1 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] log_rotate_interval_type = days {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] log_rotation_type = none {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] max_age = 0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] max_logfile_count = 30 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] max_logfile_size_mb = 200 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] max_over_subscription_ratio = 20.0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] message_reap_interval = 86400 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] message_ttl = 2592000 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] migration_create_volume_timeout_secs = 300 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] monkey_patch = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] monkey_patch_modules = [] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] my_ip = 192.168.122.10 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] no_snapshot_gb_quota = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] num_iser_scan_tries = 3 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] num_shell_tries = 3 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] num_volume_device_scan_tries = 3 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] nvmeof_conn_info_version = 1 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] nvmet_ns_id = 10 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] nvmet_port_id = 1 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] osapi_max_limit = 1000 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] osapi_volume_ext_list = [] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] osapi_volume_listen = 0.0.0.0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] osapi_volume_listen_port = 8776 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] osapi_volume_use_ssl = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] osapi_volume_workers = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] per_volume_size_limit = -1 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] periodic_fuzzy_delay = 60 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] periodic_interval = 60 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] project_id_regex = [0-9a-f\-]+ {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] public_endpoint = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] publish_errors = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] quota_backup_gigabytes = 1000 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] quota_backups = 10 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] quota_gigabytes = 1000 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] quota_groups = 10 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] quota_snapshots = 10 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] quota_volumes = 10 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] rate_limit_burst = 0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] rate_limit_except_level = CRITICAL {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] rate_limit_interval = 0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] reinit_driver_count = 3 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87211) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 17:03:05 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.quobyte [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 17:03:05 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.quobyte [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] replication_device = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] report_discard_supported = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] report_interval = 120 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Running cmd (subprocess): mount.quobyte {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] reservation_clean_interval = 86400 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] reservation_expire = 86400 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] reserved_image_namespaces = [] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] reserved_percentage = 0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] rpc_response_timeout = 120 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] run_external_periodic_tasks = True {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] scst_target_driver = iscsi {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] scst_target_iqn_name = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] service_down_time = 720 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] shell_completion = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] snapshot_name_template = snapshot-%s {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] split_loggers = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] state_path = /opt/stack/data/cinder {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] storage_availability_zone = nova {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] storage_protocol = iSCSI {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] syslog_log_facility = LOG_USER {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] target_helper = lioadm {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] target_ip_address = 192.168.122.10 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] target_port = 3260 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] target_protocol = iscsi {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] target_secondary_ip_addresses = [] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] trace_flags = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] transfer_api_class = cinder.transfer.api.API {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] transport_url = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] until_refresh = 0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] use_chap_auth = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] use_default_quota_class = True {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] use_journal = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] use_json = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] use_multipath_for_image_xfer = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] use_stderr = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] use_syslog = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] verify_glance_signatures = enabled {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] volume_api_class = cinder.volume.api.API {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] volume_backend_name = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] volume_clear = zero {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] volume_clear_ionice = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] volume_clear_size = 0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] volume_copy_bps_limit = 0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] volume_dd_blocksize = 1M {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] volume_name_template = volume-%s {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] volume_service_inithost_offload = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] volume_usage_audit_period = month {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] zoning_mode = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_concurrency.disable_process_locking = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.auth_section = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.auth_type = password {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.auth_version = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.cache = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.certfile = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.delay_auth_decision = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.http_connect_timeout = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.include_service_catalog = True {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.insecure = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.interface = public {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.keyfile = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.memcache_password = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.memcache_username = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.region_name = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.service_token_roles_required = True {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.service_type = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.token_cache_time = 300 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.10/identity {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.backend = dogpile.cache.null {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.backend_argument = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.backend_expiration_time = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.config_prefix = cache.oslo {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.debug_cache_backend = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.enable_retry_client = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.enable_socket_keepalive = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.enabled = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.expiration_time = 600 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.hashclient_retry_attempts = 2 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.memcache_dead_retry = 300 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.memcache_pool_maxsize = 10 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.memcache_sasl_enabled = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.password = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.proxies = [] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.redis_db = 0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.redis_sentinel_service_name = mymaster {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.redis_server = localhost:6379 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.retry_attempts = 2 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.retry_delay = 0.0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.socket_keepalive_count = 1 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.socket_keepalive_idle = 1 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.socket_keepalive_interval = 1 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.socket_timeout = 1.0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.tls_allowed_ciphers = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.tls_cafile = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.tls_certfile = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.tls_enabled = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.tls_keyfile = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cache.username = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] coordination.backend_url = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.asyncio_connection = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.asyncio_slave_connection = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.backend = sqlalchemy {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.connection = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.connection_debug = 0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.connection_parameters = {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.connection_recycle_time = 3600 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.connection_trace = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.db_inc_retry_interval = True {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.db_max_retries = 20 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.db_max_retry_interval = 10 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.db_retry_interval = 1 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.max_overflow = 50 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.max_pool_size = 5 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack quobyte-client[87212]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.max_retries = 10 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.mysql_wsrep_sync_wait = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.pool_timeout = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.retry_interval = 10 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.slave_connection = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.sqlite_synchronous = True {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack quobyte-client[87212]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.synchronous_reader = True {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] database.use_db_reconnect = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_tracing.insecure = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] profiler.connection_string = messaging:// {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] CMD "mount.quobyte" returned: 1 in 0.091s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:03:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:03:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] profiler.enabled = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] profiler.es_doc_type = notification {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] profiler.es_scroll_size = 10000 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] profiler.es_scroll_time = 2m {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] profiler.filter_error_trace = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] profiler.hmac_keys = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] profiler.sentinel_service_name = mymaster {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] profiler.socket_timeout = 0.1 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] profiler.trace_requests = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] profiler.trace_sqlalchemy = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] profiler_jaeger.process_tags = {} {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] profiler_jaeger.service_name_prefix = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] profiler_otlp.service_name_prefix = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_policy.enforce_new_defaults = True {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_policy.policy_default_rule = default {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_policy.policy_file = policy.yaml {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_policy.remote_timeout = 60.0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] privsep_osbrick.group = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] privsep_osbrick.helper_command = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] privsep_osbrick.user = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cinder_sys_admin.group = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cinder_sys_admin.helper_command = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] cinder_sys_admin.user = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] service_user.auth_section = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] service_user.auth_type = password {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] service_user.cafile = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] service_user.certfile = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] service_user.collect_timing = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] service_user.insecure = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] service_user.keyfile = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] service_user.send_service_user_token = True {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] service_user.split_loggers = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] service_user.timeout = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] service_user.tls_ciphers = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] service_user.tls_min_version = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] glance.auth_section = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] glance.auth_type = password {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] glance.certfile = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] glance.collect_timing = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] glance.insecure = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] glance.keyfile = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] glance.region_name = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] glance.split_loggers = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] glance.timeout = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] glance.tls_ciphers = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] glance.tls_min_version = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:03:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:03:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.backend_availability_zone = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.chap_password = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.chap_username = {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.disk_geometry = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.driver_client_cert = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.driver_client_cert_key = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.driver_data_namespace = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.driver_use_ssl = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.enable_unsupported_driver = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.extra_capabilities = {} {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.filter_function = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.goodness_function = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.iscsi_target_flags = {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.iscsi_write_cache = on {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.iser_helper = tgtadm {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.iser_ip_address = 192.168.122.10 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.iser_port = 3260 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.nas_host = {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.nas_login = admin {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.nas_mount_options = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.nas_password = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.nas_private_key = {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.nas_share_path = {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.nas_ssh_port = 22 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.num_shell_tries = 3 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.nvmet_port_id = 1 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.quobyte_client_cfg = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.quobyte_volume_url = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.replication_device = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.report_discard_supported = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.reserved_percentage = 0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.scst_target_driver = iscsi {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.scst_target_iqn_name = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.storage_protocol = iSCSI {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.target_helper = tgtadm {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.target_ip_address = 192.168.122.10 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.target_port = 3260 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.target_protocol = iscsi {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.trace_flags = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.unique_fqdn_network = True {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.use_chap_auth = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.volume_backend_name = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.volume_clear = zero {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.volume_clear_ionice = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.volume_clear_size = 0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack sudo[87214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_reports.file_event_handler = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_reports.log_dir = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.backend_availability_zone = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.backend_host = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.chap_password = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.chap_username = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.chiscsi_conf = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.disk_geometry = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.driver_client_cert = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.driver_client_cert_key = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.driver_data_namespace = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.driver_use_ssl = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.extra_capabilities = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.filter_function = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.goodness_function = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.iscsi_target_flags = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.iscsi_write_cache = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.iser_helper = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.iser_ip_address = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.iser_port = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.iser_target_prefix = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.nas_host = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.nas_login = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.nas_mount_options = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.nas_password = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.nas_private_key = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.nas_share_path = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.nas_ssh_port = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.num_shell_tries = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.nvmet_ns_id = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.nvmet_port_id = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.replication_device = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.report_discard_supported = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.reserved_percentage = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.scst_target_driver = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.storage_protocol = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.target_helper = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.target_ip_address = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.target_port = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.target_prefix = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.target_protocol = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.trace_flags = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.unique_fqdn_network = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.use_chap_auth = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.volume_clear = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.volume_clear_ionice = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.volume_clear_size = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] QuobyteHD.volumes_dir = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.ssl = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.ssl_version = {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_notifications.driver = [] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_notifications.retry = -1 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] oslo_messaging_notifications.transport_url = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] key_manager.fixed_key = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican.barbican_api_version = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican.barbican_endpoint = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican.barbican_endpoint_type = public {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican.barbican_region_name = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican.cafile = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican.certfile = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican.collect_timing = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican.insecure = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican.keyfile = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican.number_of_retries = 60 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican.retry_delay = 1 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican.send_service_user_token = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican.split_loggers = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican.timeout = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican.tls_ciphers = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican.tls_min_version = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican.verify_ssl = True {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican.verify_ssl_path = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican_service_user.auth_section = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican_service_user.auth_type = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican_service_user.cafile = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican_service_user.certfile = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican_service_user.collect_timing = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican_service_user.insecure = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican_service_user.keyfile = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican_service_user.split_loggers = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican_service_user.timeout = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican_service_user.tls_ciphers = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] barbican_service_user.tls_min_version = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] vault.approle_role_id = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] vault.approle_secret_id = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] vault.auth_method = approle {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] vault.auth_path = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] vault.kv_mountpoint = secret {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] vault.kv_path = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] vault.kv_version = 2 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] vault.namespace = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] vault.root_token_id = **** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] vault.ssl_ca_crt_file = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] vault.timeout = 60.0 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] vault.token_file = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] vault.token_role = None {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] vault.use_ssl = False {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:03:05 devstack cinder-volume[86884]: DEBUG oslo_service.backend._eventlet.service [None req-85adda2a-42e2-4218-b0f6-0b616244c21b None None] ******************************************************************************** {{(pid=86884) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 17:03:05 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root Sep 25 17:03:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.313s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:03:05 devstack cinder-volume[87211]: INFO cinder.volume.driver [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Driver hasn't implemented _init_vendor_properties() Sep 25 17:03:05 devstack cinder-volume[87211]: DEBUG cinder.volume.driver [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.299087524414, 'free_capacity_gb': 1775.299087524414, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87211) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 17:03:05 devstack cinder-volume[87211]: DEBUG oslo_db.sqlalchemy.engines [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87211) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:03:05 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writer thread running {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 17:03:05 devstack cinder-volume[87211]: DEBUG cinder.db.api [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Building query based on filter {{(pid=87211) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 17:03:06 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87211) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 17:03:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:03:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:03:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:03:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:03:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:03:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:03:06 devstack cinder-volume[87211]: INFO cinder.keymgr.migration [None req-5e737432-60de-4715-bace-219b3a865263 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 17:03:06 devstack sudo[87218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:03:06 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:03:06 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root Sep 25 17:03:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.222s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:03:06 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:03:06 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Driver initialization completed successfully. Sep 25 17:03:06 devstack cinder-volume[87211]: INFO cinder.manager [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Initiating service 3 cleanup Sep 25 17:03:06 devstack cinder-volume[87211]: INFO cinder.manager [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Service 3 cleanup completed. Sep 25 17:03:06 devstack cinder-volume[87211]: DEBUG cinder.service [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Creating RPC server for service cinder-volume {{(pid=87211) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 17:03:06 devstack cinder-volume[87211]: DEBUG cinder.service [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87211) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 17:03:06 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 17:03:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:03:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:03:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:03:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:03:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:03:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:03:06 devstack sudo[87221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:03:06 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:03:06 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root Sep 25 17:03:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.228s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:03:06 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b551b0c8-6468-4443-af01-c7b198b9facb None None] Driver post RPC initialization completed successfully. Sep 25 17:03:15 devstack cinder-volume[86884]: DEBUG dbcounter [-] [86884] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86884) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:03:16 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=2 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:03:16 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:03:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:03:53 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 6 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:03:53 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:04:05 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:04:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Flow 'volume_create_manager' (6f833862-5444-43dc-95b8-c4848416d450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:04:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c7e179-1a34-423b-b7f9-1a6d52dcc21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c7e179-1a34-423b-b7f9-1a6d52dcc21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1421652922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db520a98-8931-4aea-8cec-838bf004c7ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ce9742c8c74b098403e15f61d2ee1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:05Z,use_quota=True,user_id='27fcbc439f5b48ec8b139396ff0f582b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3708d4-9acd-4d6b-9b7a-ac02d0645f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3708d4-9acd-4d6b-9b7a-ac02d0645f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1e6253-c4f0-4ff9-8651-896744d3990a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1e6253-c4f0-4ff9-8651-896744d3990a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db520a98-8931-4aea-8cec-838bf004c7ae', 'volume_name': 'volume-db520a98-8931-4aea-8cec-838bf004c7ae', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (243ca490-6e40-40f6-aa54-71459a82e318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (243ca490-6e40-40f6-aa54-71459a82e318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94281f80-9431-4416-bf53-4340aaa6eb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:05 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Volume db520a98-8931-4aea-8cec-838bf004c7ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db520a98-8931-4aea-8cec-838bf004c7ae', 'volume_size': 1} Sep 25 17:04:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1421652922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db520a98-8931-4aea-8cec-838bf004c7ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ce9742c8c74b098403e15f61d2ee1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:05Z,use_quota=True,user_id='27fcbc439f5b48ec8b139396ff0f582b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:04:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Creating volume db520a98-8931-4aea-8cec-838bf004c7ae {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:04:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:04:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:04:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:04:05 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:04:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-db520a98-8931-4aea-8cec-838bf004c7ae 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:05 devstack sudo[87598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-db520a98-8931-4aea-8cec-838bf004c7ae 1073741824 Sep 25 17:04:05 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:06 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:04:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Flow 'volume_create_manager' (d0539418-c027-4f32-a536-5142cf8f042a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:04:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d47385-25f9-4a21-8835-83f9a8a4572d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d47385-25f9-4a21-8835-83f9a8a4572d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-900914007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96acdd6e-c476-42d4-8251-216a62d8d7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fabeb3b3f198417d81be6d65e43c40f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:06Z,use_quota=True,user_id='7484dfe44f8143c08c5ea07e44a09836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eabb32fb-ff1a-4029-929e-883ce48d4faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eabb32fb-ff1a-4029-929e-883ce48d4faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76aabb66-c6e1-4c7e-a26d-1f629e0882b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76aabb66-c6e1-4c7e-a26d-1f629e0882b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96acdd6e-c476-42d4-8251-216a62d8d7f0', 'volume_name': 'volume-96acdd6e-c476-42d4-8251-216a62d8d7f0', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ceca8d-0b56-4d4a-91c7-c9a268b0dc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ceca8d-0b56-4d4a-91c7-c9a268b0dc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40edbe77-6747-4d02-9e96-bda182e20bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:06 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Volume 96acdd6e-c476-42d4-8251-216a62d8d7f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96acdd6e-c476-42d4-8251-216a62d8d7f0', 'volume_size': 1} Sep 25 17:04:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:06 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-db520a98-8931-4aea-8cec-838bf004c7ae 1073741824" returned: 0 in 1.198s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-db520a98-8931-4aea-8cec-838bf004c7ae {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:07 devstack sudo[87934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-db520a98-8931-4aea-8cec-838bf004c7ae Sep 25 17:04:07 devstack sudo[87934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:07 devstack sudo[87934]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-db520a98-8931-4aea-8cec-838bf004c7ae" returned: 0 in 0.392s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:04:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.768s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-900914007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96acdd6e-c476-42d4-8251-216a62d8d7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fabeb3b3f198417d81be6d65e43c40f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:06Z,use_quota=True,user_id='7484dfe44f8143c08c5ea07e44a09836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:04:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Creating volume 96acdd6e-c476-42d4-8251-216a62d8d7f0 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:04:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:04:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:04:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:04:07 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:04:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:07 devstack sudo[87944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0 1073741824 Sep 25 17:04:07 devstack sudo[87944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94281f80-9431-4416-bf53-4340aaa6eb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db520a98-8931-4aea-8cec-838bf004c7ae', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be4e27c-1a49-420a-b640-fac360b2cdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:07 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Volume volume-db520a98-8931-4aea-8cec-838bf004c7ae (db520a98-8931-4aea-8cec-838bf004c7ae): created successfully Sep 25 17:04:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be4e27c-1a49-420a-b640-fac360b2cdd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Flow 'volume_create_manager' (6f833862-5444-43dc-95b8-c4848416d450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:04:07 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-ce9ea756-ac7f-4ac4-83ad-8ef3a217ecc4 tempest-DeleteServersTestJSON-996900619 None] Created volume successfully. Sep 25 17:04:08 devstack sudo[87944]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0 1073741824" returned: 0 in 1.080s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:08 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0 Sep 25 17:04:08 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:08 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0" returned: 0 in 0.324s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:04:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40edbe77-6747-4d02-9e96-bda182e20bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96acdd6e-c476-42d4-8251-216a62d8d7f0', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a49a43a-b2ce-4962-ac90-5160de87e00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:09 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Volume volume-96acdd6e-c476-42d4-8251-216a62d8d7f0 (96acdd6e-c476-42d4-8251-216a62d8d7f0): created successfully Sep 25 17:04:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a49a43a-b2ce-4962-ac90-5160de87e00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Flow 'volume_create_manager' (d0539418-c027-4f32-a536-5142cf8f042a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:04:09 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-9f2b7e49-7661-4afa-b38c-6ab1ad5daee8 tempest-SnapshotsActionsTest-45555313 None] Created volume successfully. Sep 25 17:04:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-10d94eab-d20e-44d7-ba24-ddffee71f123 tempest-SnapshotsActionsTest-45555313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-10d94eab-d20e-44d7-ba24-ddffee71f123 tempest-SnapshotsActionsTest-45555313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:09 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-10d94eab-d20e-44d7-ba24-ddffee71f123 tempest-SnapshotsActionsTest-45555313 None] Creating offline snapshot 93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 of volume 96acdd6e-c476-42d4-8251-216a62d8d7f0 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:04:09 devstack cinder-volume[87211]: INFO oslo.privsep.daemon [None req-10d94eab-d20e-44d7-ba24-ddffee71f123 tempest-SnapshotsActionsTest-45555313 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp26hz2s1g/privsep.sock'] Sep 25 17:04:09 devstack sudo[88009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp26hz2s1g/privsep.sock Sep 25 17:04:09 devstack sudo[88009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:10 devstack cinder-volume[87211]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 25 17:04:10 devstack cinder-volume[87211]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 17:04:10 devstack cinder-volume[87211]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 25 17:04:10 devstack cinder-volume[87211]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 17:04:10 devstack cinder-volume[87211]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 25 17:04:10 devstack cinder-volume[87211]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 25 17:04:10 devstack cinder-volume[87211]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 17:04:10 devstack cinder-volume[87211]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 17:04:10 devstack cinder-volume[87211]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 25 17:04:11 devstack sudo[88009]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:11 devstack cinder-volume[87211]: INFO oslo.privsep.daemon [None req-10d94eab-d20e-44d7-ba24-ddffee71f123 tempest-SnapshotsActionsTest-45555313 None] Spawned new privsep daemon via rootwrap Sep 25 17:04:11 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [None req-10d94eab-d20e-44d7-ba24-ddffee71f123 tempest-SnapshotsActionsTest-45555313 None] Accepted privsep connection to /tmp/tmp26hz2s1g/privsep.sock {{(pid=87211) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 25 17:04:11 devstack cinder-volume[87211]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 25 17:04:11 devstack cinder-volume[87211]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 25 17:04:11 devstack cinder-volume[87211]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 25 17:04:11 devstack cinder-volume[87211]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88017 Sep 25 17:04:11 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55e9e24-e8b8-4706-b9bc-963ba21f30cf]: (2,) {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:11 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7a57d0-3c4a-43f1-939b-183afb10c7c7]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-10d94eab-d20e-44d7-ba24-ddffee71f123 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:11 devstack sudo[88019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0 Sep 25 17:04:11 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:11 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-10d94eab-d20e-44d7-ba24-ddffee71f123 tempest-SnapshotsActionsTest-45555313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0" returned: 0 in 0.439s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-10d94eab-d20e-44d7-ba24-ddffee71f123 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:11 devstack sudo[88036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 1G Sep 25 17:04:11 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:11 devstack cinder-volume[87211]: WARNING py.warnings [req-2519067c-9f3e-452f-a2c7-ff0deda3c213 req-581b1b47-b413-4094-8cc7-c9f4874d77f1 tempest-DeleteServersTestJSON-996900619 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 25 17:04:11 devstack cinder-volume[87211]: .first() Sep 25 17:04:11 devstack cinder-volume[87211]: Sep 25 17:04:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-2519067c-9f3e-452f-a2c7-ff0deda3c213 req-581b1b47-b413-4094-8cc7-c9f4874d77f1 tempest-DeleteServersTestJSON-996900619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:12 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-10d94eab-d20e-44d7-ba24-ddffee71f123 tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 1G" returned: 0 in 0.847s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-10d94eab-d20e-44d7-ba24-ddffee71f123 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96acdd6e-c476-42d4-8251-216a62d8d7f0 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:12 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96acdd6e-c476-42d4-8251-216a62d8d7f0 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 Sep 25 17:04:12 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:12 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-10d94eab-d20e-44d7-ba24-ddffee71f123 tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96acdd6e-c476-42d4-8251-216a62d8d7f0 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266" returned: 0 in 0.421s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:12 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-10d94eab-d20e-44d7-ba24-ddffee71f123 tempest-SnapshotsActionsTest-45555313 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 is being set with open permissions: ugo+rw Sep 25 17:04:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-10d94eab-d20e-44d7-ba24-ddffee71f123 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:12 devstack sudo[88111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 Sep 25 17:04:12 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:13 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-10d94eab-d20e-44d7-ba24-ddffee71f123 tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266" returned: 0 in 0.331s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-10d94eab-d20e-44d7-ba24-ddffee71f123 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:13 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.info Sep 25 17:04:13 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:13 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-10d94eab-d20e-44d7-ba24-ddffee71f123 tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.info" returned: 0 in 0.555s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:13 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-10d94eab-d20e-44d7-ba24-ddffee71f123 tempest-SnapshotsActionsTest-45555313 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.info is being set with open permissions: ugo+rw Sep 25 17:04:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-10d94eab-d20e-44d7-ba24-ddffee71f123 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:13 devstack sudo[88148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.info Sep 25 17:04:13 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:14 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-10d94eab-d20e-44d7-ba24-ddffee71f123 tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.info" returned: 0 in 0.301s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-10d94eab-d20e-44d7-ba24-ddffee71f123 tempest-SnapshotsActionsTest-45555313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.416s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-2519067c-9f3e-452f-a2c7-ff0deda3c213 req-581b1b47-b413-4094-8cc7-c9f4874d77f1 tempest-DeleteServersTestJSON-996900619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.141s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:14 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-10d94eab-d20e-44d7-ba24-ddffee71f123 tempest-SnapshotsActionsTest-45555313 None] Create snapshot completed successfully Sep 25 17:04:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-2519067c-9f3e-452f-a2c7-ff0deda3c213 req-581b1b47-b413-4094-8cc7-c9f4874d77f1 tempest-DeleteServersTestJSON-996900619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.130s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-2519067c-9f3e-452f-a2c7-ff0deda3c213 req-581b1b47-b413-4094-8cc7-c9f4874d77f1 tempest-DeleteServersTestJSON-996900619 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-db520a98-8931-4aea-8cec-838bf004c7ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06aabc25-6304-4eaf-bf9b-c517c256aa5f', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:04:14 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-2519067c-9f3e-452f-a2c7-ff0deda3c213 req-581b1b47-b413-4094-8cc7-c9f4874d77f1 tempest-DeleteServersTestJSON-996900619 None] attachment_update completed successfully. Sep 25 17:04:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b19eeac6-ff63-4e55-a287-662e40b2d9b8 tempest-SnapshotsActionsTest-45555313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b19eeac6-ff63-4e55-a287-662e40b2d9b8 tempest-SnapshotsActionsTest-45555313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b19eeac6-ff63-4e55-a287-662e40b2d9b8 tempest-SnapshotsActionsTest-45555313 None] Creating offline snapshot d67c4d14-1f92-4da2-b602-f5fb53432e4d of volume 96acdd6e-c476-42d4-8251-216a62d8d7f0 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:04:16 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f14c52a-96ed-4c9e-950d-5575eeeaedc6]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b19eeac6-ff63-4e55-a287-662e40b2d9b8 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:17 devstack sudo[88580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 Sep 25 17:04:17 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:17 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b19eeac6-ff63-4e55-a287-662e40b2d9b8 tempest-SnapshotsActionsTest-45555313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266" returned: 0 in 0.643s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b19eeac6-ff63-4e55-a287-662e40b2d9b8 tempest-SnapshotsActionsTest-45555313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96acdd6e-c476-42d4-8251-216a62d8d7f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:04:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b19eeac6-ff63-4e55-a287-662e40b2d9b8 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.d67c4d14-1f92-4da2-b602-f5fb53432e4d 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:17 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.d67c4d14-1f92-4da2-b602-f5fb53432e4d 1G Sep 25 17:04:17 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:18 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b19eeac6-ff63-4e55-a287-662e40b2d9b8 tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.d67c4d14-1f92-4da2-b602-f5fb53432e4d 1G" returned: 0 in 1.010s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b19eeac6-ff63-4e55-a287-662e40b2d9b8 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.d67c4d14-1f92-4da2-b602-f5fb53432e4d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:18 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.d67c4d14-1f92-4da2-b602-f5fb53432e4d Sep 25 17:04:18 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:19 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b19eeac6-ff63-4e55-a287-662e40b2d9b8 tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.d67c4d14-1f92-4da2-b602-f5fb53432e4d" returned: 0 in 0.604s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:19 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-b19eeac6-ff63-4e55-a287-662e40b2d9b8 tempest-SnapshotsActionsTest-45555313 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.d67c4d14-1f92-4da2-b602-f5fb53432e4d is being set with open permissions: ugo+rw Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b19eeac6-ff63-4e55-a287-662e40b2d9b8 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.d67c4d14-1f92-4da2-b602-f5fb53432e4d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:19 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.d67c4d14-1f92-4da2-b602-f5fb53432e4d Sep 25 17:04:19 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:04:19 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Flow 'volume_create_manager' (e1c98c4b-8354-4a0f-9403-c76ef897cea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc99d409-d054-495a-bff4-658d250da139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b19eeac6-ff63-4e55-a287-662e40b2d9b8 tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.d67c4d14-1f92-4da2-b602-f5fb53432e4d" returned: 0 in 0.511s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc99d409-d054-495a-bff4-658d250da139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1226993198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72032826-ae4a-43c2-a7a2-5a89d2f050cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c46b9582e94273a972920aa9be044b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:20Z,use_quota=True,user_id='01f4733d77c04758816a0a877e844972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b215ca-43d3-40b8-93f2-c88ea1059ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b215ca-43d3-40b8-93f2-c88ea1059ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f354d807-fb63-4ec0-8edd-c53e5901b5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f354d807-fb63-4ec0-8edd-c53e5901b5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72032826-ae4a-43c2-a7a2-5a89d2f050cb', 'volume_name': 'volume-72032826-ae4a-43c2-a7a2-5a89d2f050cb', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905359bc-f4fe-4f63-959f-deb983b0f55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905359bc-f4fe-4f63-959f-deb983b0f55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2771d9a0-9785-47f8-81cd-e12ebf009e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:19 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Volume 72032826-ae4a-43c2-a7a2-5a89d2f050cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72032826-ae4a-43c2-a7a2-5a89d2f050cb', 'volume_size': 1} Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b19eeac6-ff63-4e55-a287-662e40b2d9b8 tempest-SnapshotsActionsTest-45555313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.162s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.126s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1226993198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72032826-ae4a-43c2-a7a2-5a89d2f050cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c46b9582e94273a972920aa9be044b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:20Z,use_quota=True,user_id='01f4733d77c04758816a0a877e844972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Creating volume 72032826-ae4a-43c2-a7a2-5a89d2f050cb {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:04:19 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:04:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-72032826-ae4a-43c2-a7a2-5a89d2f050cb 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:19 devstack sudo[88653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-72032826-ae4a-43c2-a7a2-5a89d2f050cb 1073741824 Sep 25 17:04:19 devstack sudo[88653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:20 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b19eeac6-ff63-4e55-a287-662e40b2d9b8 tempest-SnapshotsActionsTest-45555313 None] Create snapshot completed successfully Sep 25 17:04:20 devstack sudo[88653]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-72032826-ae4a-43c2-a7a2-5a89d2f050cb 1073741824" returned: 0 in 0.742s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-72032826-ae4a-43c2-a7a2-5a89d2f050cb {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:20 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-72032826-ae4a-43c2-a7a2-5a89d2f050cb Sep 25 17:04:20 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:21 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-72032826-ae4a-43c2-a7a2-5a89d2f050cb" returned: 0 in 0.373s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:21 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:04:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2771d9a0-9785-47f8-81cd-e12ebf009e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72032826-ae4a-43c2-a7a2-5a89d2f050cb', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d618710-d5e7-41f8-b346-906f438ba1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:21 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Volume volume-72032826-ae4a-43c2-a7a2-5a89d2f050cb (72032826-ae4a-43c2-a7a2-5a89d2f050cb): created successfully Sep 25 17:04:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d618710-d5e7-41f8-b346-906f438ba1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Flow 'volume_create_manager' (e1c98c4b-8354-4a0f-9403-c76ef897cea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:04:21 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-e4980938-81ef-4e02-b68f-89a9ddd2b115 tempest-VolumesAdminNegativeTest-2085229422 None] Created volume successfully. Sep 25 17:04:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] Acquiring lock "cinder-d67c4d14-1f92-4da2-b602-f5fb53432e4d-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-d67c4d14-1f92-4da2-b602-f5fb53432e4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] Acquiring lock "cinder-quobyte-96acdd6e-c476-42d4-8251-216a62d8d7f0" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:21 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-83c50fca-1335-4b99-b35b-42ccb75f2ff2 req-3e6db3b7-db62-4e10-987e-468e030ef8f4 tempest-DeleteServersTestJSON-996900619 None] Terminate volume connection completed successfully. Sep 25 17:04:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-83c50fca-1335-4b99-b35b-42ccb75f2ff2 req-3e6db3b7-db62-4e10-987e-468e030ef8f4 tempest-DeleteServersTestJSON-996900619 None] Deleting attachment 06aabc25-6304-4eaf-bf9b-c517c256aa5f. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:04:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-quobyte-96acdd6e-c476-42d4-8251-216a62d8d7f0" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] Acquiring lock "cinder-quobyte-d67c4d14-1f92-4da2-b602-f5fb53432e4d" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-quobyte-d67c4d14-1f92-4da2-b602-f5fb53432e4d" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:21 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] Deleting offline snapshot d67c4d14-1f92-4da2-b602-f5fb53432e4d of volume 96acdd6e-c476-42d4-8251-216a62d8d7f0 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:04:21 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] snapshot_file for this snap is: volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.d67c4d14-1f92-4da2-b602-f5fb53432e4d {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:04:21 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea63b69-f14d-46d0-a4d2-d570b7758e55]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.d67c4d14-1f92-4da2-b602-f5fb53432e4d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:21 devstack sudo[88673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.d67c4d14-1f92-4da2-b602-f5fb53432e4d Sep 25 17:04:21 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3f7251b9-b9b6-47b5-a83e-7388f075040d tempest-VolumesAdminNegativeTest-2085229422 None] Acquiring lock "cinder-72032826-ae4a-43c2-a7a2-5a89d2f050cb-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:22 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.d67c4d14-1f92-4da2-b602-f5fb53432e4d" returned: 0 in 0.796s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96acdd6e-c476-42d4-8251-216a62d8d7f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:04:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3f7251b9-b9b6-47b5-a83e-7388f075040d tempest-VolumesAdminNegativeTest-2085229422 None] Lock "cinder-72032826-ae4a-43c2-a7a2-5a89d2f050cb-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:22 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b73ac21-c65e-4ca1-9593-2b4494e0f868]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3f7251b9-b9b6-47b5-a83e-7388f075040d tempest-VolumesAdminNegativeTest-2085229422 None] Acquiring lock "cinder-quobyte-72032826-ae4a-43c2-a7a2-5a89d2f050cb" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3f7251b9-b9b6-47b5-a83e-7388f075040d tempest-VolumesAdminNegativeTest-2085229422 None] Lock "cinder-quobyte-72032826-ae4a-43c2-a7a2-5a89d2f050cb" acquired by "delete_volume" :: waited 0.045s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:22 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 Sep 25 17:04:22 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:22 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d353fa1-bd18-49c9-9d67-0bcdca00ff1d]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3f7251b9-b9b6-47b5-a83e-7388f075040d tempest-VolumesAdminNegativeTest-2085229422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-72032826-ae4a-43c2-a7a2-5a89d2f050cb {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:22 devstack sudo[88683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-72032826-ae4a-43c2-a7a2-5a89d2f050cb Sep 25 17:04:22 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:23 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266" returned: 0 in 0.460s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96acdd6e-c476-42d4-8251-216a62d8d7f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:04:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.d67c4d14-1f92-4da2-b602-f5fb53432e4d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:23 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.d67c4d14-1f92-4da2-b602-f5fb53432e4d Sep 25 17:04:23 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:23 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3f7251b9-b9b6-47b5-a83e-7388f075040d tempest-VolumesAdminNegativeTest-2085229422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-72032826-ae4a-43c2-a7a2-5a89d2f050cb" returned: 0 in 0.537s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3f7251b9-b9b6-47b5-a83e-7388f075040d tempest-VolumesAdminNegativeTest-2085229422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-72032826-ae4a-43c2-a7a2-5a89d2f050cb {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:23 devstack sudo[88695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-72032826-ae4a-43c2-a7a2-5a89d2f050cb Sep 25 17:04:23 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:23 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3f7251b9-b9b6-47b5-a83e-7388f075040d tempest-VolumesAdminNegativeTest-2085229422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-72032826-ae4a-43c2-a7a2-5a89d2f050cb" returned: 0 in 0.288s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3f7251b9-b9b6-47b5-a83e-7388f075040d tempest-VolumesAdminNegativeTest-2085229422 None] Lock "cinder-quobyte-72032826-ae4a-43c2-a7a2-5a89d2f050cb" released by "delete_volume" :: held 0.900s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:23 devstack cinder-volume[87211]: WARNING cinder.quota [None req-3f7251b9-b9b6-47b5-a83e-7388f075040d tempest-VolumesAdminNegativeTest-2085229422 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:04:23 devstack cinder-volume[87211]: WARNING cinder.quota [None req-3f7251b9-b9b6-47b5-a83e-7388f075040d tempest-VolumesAdminNegativeTest-2085229422 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:04:23 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-3f7251b9-b9b6-47b5-a83e-7388f075040d tempest-VolumesAdminNegativeTest-2085229422 None] Created reservations ['4c66d774-eb7d-4255-8f5d-0756d77f429f', '69199ab0-049f-4f1d-b80d-79d80af3bc56', 'afa489b4-1d69-485d-b8a2-c3f341e94c7d', '6ad677f9-2d7b-4b65-bb93-502fde85c322'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:04:23 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.d67c4d14-1f92-4da2-b602-f5fb53432e4d" returned: 0 in 0.687s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.d67c4d14-1f92-4da2-b602-f5fb53432e4d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:23 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.d67c4d14-1f92-4da2-b602-f5fb53432e4d Sep 25 17:04:23 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3f7251b9-b9b6-47b5-a83e-7388f075040d tempest-VolumesAdminNegativeTest-2085229422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3f7251b9-b9b6-47b5-a83e-7388f075040d tempest-VolumesAdminNegativeTest-2085229422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3f7251b9-b9b6-47b5-a83e-7388f075040d tempest-VolumesAdminNegativeTest-2085229422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:04:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3f7251b9-b9b6-47b5-a83e-7388f075040d tempest-VolumesAdminNegativeTest-2085229422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:04:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3f7251b9-b9b6-47b5-a83e-7388f075040d tempest-VolumesAdminNegativeTest-2085229422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3f7251b9-b9b6-47b5-a83e-7388f075040d tempest-VolumesAdminNegativeTest-2085229422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:23 devstack sudo[88704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:04:23 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:24 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.d67c4d14-1f92-4da2-b602-f5fb53432e4d" returned: 0 in 0.494s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:24 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3f7251b9-b9b6-47b5-a83e-7388f075040d tempest-VolumesAdminNegativeTest-2085229422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.389s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:24 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-3f7251b9-b9b6-47b5-a83e-7388f075040d tempest-VolumesAdminNegativeTest-2085229422 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:04:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-quobyte-d67c4d14-1f92-4da2-b602-f5fb53432e4d" released by "_delete_snapshot" :: held 2.697s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:24 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-3f7251b9-b9b6-47b5-a83e-7388f075040d tempest-VolumesAdminNegativeTest-2085229422 None] Deleted volume successfully. Sep 25 17:04:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-quobyte-96acdd6e-c476-42d4-8251-216a62d8d7f0" released by "delete_snapshot" :: held 2.768s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3f7251b9-b9b6-47b5-a83e-7388f075040d tempest-VolumesAdminNegativeTest-2085229422 None] Lock "cinder-72032826-ae4a-43c2-a7a2-5a89d2f050cb-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:24 devstack cinder-volume[87211]: WARNING cinder.quota [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:04:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-49fd4f8c-80b0-4097-8799-748801332ab5 tempest-DeleteServersTestJSON-996900619 None] Acquiring lock "cinder-db520a98-8931-4aea-8cec-838bf004c7ae-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-49fd4f8c-80b0-4097-8799-748801332ab5 tempest-DeleteServersTestJSON-996900619 None] Lock "cinder-db520a98-8931-4aea-8cec-838bf004c7ae-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:24 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] Created reservations ['92f8e9ea-8f7e-4855-b20c-db030d6544cf', '214da182-5e2a-4259-ac85-d571c00f9110', '26c1e8cf-3d49-4583-9d71-bfbb6340c762', '483d3f92-df62-4425-80cf-626dbd2e579e'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:04:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-49fd4f8c-80b0-4097-8799-748801332ab5 tempest-DeleteServersTestJSON-996900619 None] Acquiring lock "cinder-quobyte-db520a98-8931-4aea-8cec-838bf004c7ae" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:24 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] Delete snapshot completed successfully. Sep 25 17:04:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-49fd4f8c-80b0-4097-8799-748801332ab5 tempest-DeleteServersTestJSON-996900619 None] Lock "cinder-quobyte-db520a98-8931-4aea-8cec-838bf004c7ae" acquired by "delete_volume" :: waited 0.044s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fbdd41cc-b62b-4876-bbf4-a702624718c6 tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-d67c4d14-1f92-4da2-b602-f5fb53432e4d-delete_snapshot" released by "delete_snapshot" :: held 3.164s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:24 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[2754f395-8bf3-4fe0-a524-d0686578c590]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-49fd4f8c-80b0-4097-8799-748801332ab5 tempest-DeleteServersTestJSON-996900619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-db520a98-8931-4aea-8cec-838bf004c7ae {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:24 devstack sudo[88711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-db520a98-8931-4aea-8cec-838bf004c7ae Sep 25 17:04:24 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-15848d77-0fed-4fdd-94e0-c526559fe55a tempest-SnapshotsActionsTest-45555313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-15848d77-0fed-4fdd-94e0-c526559fe55a tempest-SnapshotsActionsTest-45555313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:25 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-15848d77-0fed-4fdd-94e0-c526559fe55a tempest-SnapshotsActionsTest-45555313 None] Creating offline snapshot a8935e07-1995-4a72-85e5-f95d561d42e9 of volume 96acdd6e-c476-42d4-8251-216a62d8d7f0 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:04:25 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec47f24-28b5-44bc-b175-74fae18eebf7]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-15848d77-0fed-4fdd-94e0-c526559fe55a tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:25 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-49fd4f8c-80b0-4097-8799-748801332ab5 tempest-DeleteServersTestJSON-996900619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-db520a98-8931-4aea-8cec-838bf004c7ae" returned: 0 in 0.664s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-49fd4f8c-80b0-4097-8799-748801332ab5 tempest-DeleteServersTestJSON-996900619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-db520a98-8931-4aea-8cec-838bf004c7ae {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:25 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-db520a98-8931-4aea-8cec-838bf004c7ae Sep 25 17:04:25 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:25 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 Sep 25 17:04:25 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:25 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-49fd4f8c-80b0-4097-8799-748801332ab5 tempest-DeleteServersTestJSON-996900619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-db520a98-8931-4aea-8cec-838bf004c7ae" returned: 0 in 0.477s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-49fd4f8c-80b0-4097-8799-748801332ab5 tempest-DeleteServersTestJSON-996900619 None] Lock "cinder-quobyte-db520a98-8931-4aea-8cec-838bf004c7ae" released by "delete_volume" :: held 1.237s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:26 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:26 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-49fd4f8c-80b0-4097-8799-748801332ab5 tempest-DeleteServersTestJSON-996900619 None] Created reservations ['b936768f-986e-43fc-9a8b-18750f481775', '21ebed85-39fd-441c-a42c-0b0c62d79e2b', '63f15fef-6be3-4642-b28c-26a5641dd703', 'b752212c-0fb3-4caf-b4b2-5f6d22efe04c'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:04:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-15848d77-0fed-4fdd-94e0-c526559fe55a tempest-SnapshotsActionsTest-45555313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266" returned: 0 in 0.669s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-15848d77-0fed-4fdd-94e0-c526559fe55a tempest-SnapshotsActionsTest-45555313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96acdd6e-c476-42d4-8251-216a62d8d7f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:04:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-15848d77-0fed-4fdd-94e0-c526559fe55a tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a8935e07-1995-4a72-85e5-f95d561d42e9 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:26 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a8935e07-1995-4a72-85e5-f95d561d42e9 1G Sep 25 17:04:26 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-49fd4f8c-80b0-4097-8799-748801332ab5 tempest-DeleteServersTestJSON-996900619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-49fd4f8c-80b0-4097-8799-748801332ab5 tempest-DeleteServersTestJSON-996900619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-49fd4f8c-80b0-4097-8799-748801332ab5 tempest-DeleteServersTestJSON-996900619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:04:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-49fd4f8c-80b0-4097-8799-748801332ab5 tempest-DeleteServersTestJSON-996900619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:04:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-49fd4f8c-80b0-4097-8799-748801332ab5 tempest-DeleteServersTestJSON-996900619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-49fd4f8c-80b0-4097-8799-748801332ab5 tempest-DeleteServersTestJSON-996900619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:26 devstack sudo[88787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:04:26 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:26 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-49fd4f8c-80b0-4097-8799-748801332ab5 tempest-DeleteServersTestJSON-996900619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.420s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:26 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-49fd4f8c-80b0-4097-8799-748801332ab5 tempest-DeleteServersTestJSON-996900619 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:04:26 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-49fd4f8c-80b0-4097-8799-748801332ab5 tempest-DeleteServersTestJSON-996900619 None] Deleted volume successfully. Sep 25 17:04:26 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-49fd4f8c-80b0-4097-8799-748801332ab5 tempest-DeleteServersTestJSON-996900619 None] Lock "cinder-db520a98-8931-4aea-8cec-838bf004c7ae-delete_volume" released by "delete_volume" :: held 2.154s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:26 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-15848d77-0fed-4fdd-94e0-c526559fe55a tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a8935e07-1995-4a72-85e5-f95d561d42e9 1G" returned: 0 in 0.724s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-15848d77-0fed-4fdd-94e0-c526559fe55a tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a8935e07-1995-4a72-85e5-f95d561d42e9 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:26 devstack sudo[88798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a8935e07-1995-4a72-85e5-f95d561d42e9 Sep 25 17:04:26 devstack sudo[88798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:27 devstack sudo[88798]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-15848d77-0fed-4fdd-94e0-c526559fe55a tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a8935e07-1995-4a72-85e5-f95d561d42e9" returned: 0 in 0.396s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:27 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-15848d77-0fed-4fdd-94e0-c526559fe55a tempest-SnapshotsActionsTest-45555313 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a8935e07-1995-4a72-85e5-f95d561d42e9 is being set with open permissions: ugo+rw Sep 25 17:04:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-15848d77-0fed-4fdd-94e0-c526559fe55a tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a8935e07-1995-4a72-85e5-f95d561d42e9 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:27 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a8935e07-1995-4a72-85e5-f95d561d42e9 Sep 25 17:04:27 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:27 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-15848d77-0fed-4fdd-94e0-c526559fe55a tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a8935e07-1995-4a72-85e5-f95d561d42e9" returned: 0 in 0.373s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-15848d77-0fed-4fdd-94e0-c526559fe55a tempest-SnapshotsActionsTest-45555313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.389s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:27 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-15848d77-0fed-4fdd-94e0-c526559fe55a tempest-SnapshotsActionsTest-45555313 None] Create snapshot completed successfully Sep 25 17:04:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] Acquiring lock "cinder-a8935e07-1995-4a72-85e5-f95d561d42e9-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-a8935e07-1995-4a72-85e5-f95d561d42e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] Acquiring lock "cinder-quobyte-96acdd6e-c476-42d4-8251-216a62d8d7f0" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-quobyte-96acdd6e-c476-42d4-8251-216a62d8d7f0" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] Acquiring lock "cinder-quobyte-a8935e07-1995-4a72-85e5-f95d561d42e9" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-quobyte-a8935e07-1995-4a72-85e5-f95d561d42e9" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:28 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] Deleting offline snapshot a8935e07-1995-4a72-85e5-f95d561d42e9 of volume 96acdd6e-c476-42d4-8251-216a62d8d7f0 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:04:28 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] snapshot_file for this snap is: volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a8935e07-1995-4a72-85e5-f95d561d42e9 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:04:28 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cf8925-9c41-44a2-ae1a-0f7305573bd9]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a8935e07-1995-4a72-85e5-f95d561d42e9 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:28 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a8935e07-1995-4a72-85e5-f95d561d42e9 Sep 25 17:04:28 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:29 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a8935e07-1995-4a72-85e5-f95d561d42e9" returned: 0 in 0.392s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:29 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96acdd6e-c476-42d4-8251-216a62d8d7f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:04:29 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9589d7c7-147a-4f18-a987-fc96700b46ad]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:29 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 Sep 25 17:04:29 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:29 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266" returned: 0 in 0.429s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:29 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96acdd6e-c476-42d4-8251-216a62d8d7f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:04:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a8935e07-1995-4a72-85e5-f95d561d42e9 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:29 devstack sudo[88823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a8935e07-1995-4a72-85e5-f95d561d42e9 Sep 25 17:04:29 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:30 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a8935e07-1995-4a72-85e5-f95d561d42e9" returned: 0 in 0.493s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a8935e07-1995-4a72-85e5-f95d561d42e9 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:30 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a8935e07-1995-4a72-85e5-f95d561d42e9 Sep 25 17:04:30 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:30 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a8935e07-1995-4a72-85e5-f95d561d42e9" returned: 0 in 0.271s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-quobyte-a8935e07-1995-4a72-85e5-f95d561d42e9" released by "_delete_snapshot" :: held 1.708s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-quobyte-96acdd6e-c476-42d4-8251-216a62d8d7f0" released by "delete_snapshot" :: held 1.748s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:30 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] Created reservations ['5d200f0a-0c39-4dcf-8dff-128bbc89f8be', '0553bcf1-0244-4c54-8dbe-6d58bea19ff6', 'bcc9f001-7af7-4733-a42e-4cac70fba5fa', '4516645d-003b-45d6-8f76-ceddd1145956'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:04:30 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] Delete snapshot completed successfully. Sep 25 17:04:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-aa9f5b3c-3c9a-4bd0-b3c0-c611b454133f tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-a8935e07-1995-4a72-85e5-f95d561d42e9-delete_snapshot" released by "delete_snapshot" :: held 1.928s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2ef50b47-623a-4a01-ad95-039c9e6afb23 tempest-SnapshotsActionsTest-45555313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2ef50b47-623a-4a01-ad95-039c9e6afb23 tempest-SnapshotsActionsTest-45555313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:31 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-2ef50b47-623a-4a01-ad95-039c9e6afb23 tempest-SnapshotsActionsTest-45555313 None] Creating offline snapshot 5e3de829-43ab-4035-aa78-20778b968d51 of volume 96acdd6e-c476-42d4-8251-216a62d8d7f0 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:04:31 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9fdaf2-ac0a-4223-a45b-025ec55267a4]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2ef50b47-623a-4a01-ad95-039c9e6afb23 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:31 devstack sudo[88833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 Sep 25 17:04:31 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:31 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2ef50b47-623a-4a01-ad95-039c9e6afb23 tempest-SnapshotsActionsTest-45555313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266" returned: 0 in 0.550s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:31 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-2ef50b47-623a-4a01-ad95-039c9e6afb23 tempest-SnapshotsActionsTest-45555313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96acdd6e-c476-42d4-8251-216a62d8d7f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:04:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2ef50b47-623a-4a01-ad95-039c9e6afb23 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.5e3de829-43ab-4035-aa78-20778b968d51 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:31 devstack sudo[88839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.5e3de829-43ab-4035-aa78-20778b968d51 1G Sep 25 17:04:31 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:32 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2ef50b47-623a-4a01-ad95-039c9e6afb23 tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.5e3de829-43ab-4035-aa78-20778b968d51 1G" returned: 0 in 0.628s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2ef50b47-623a-4a01-ad95-039c9e6afb23 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.5e3de829-43ab-4035-aa78-20778b968d51 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:32 devstack sudo[88844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.5e3de829-43ab-4035-aa78-20778b968d51 Sep 25 17:04:32 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:32 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2ef50b47-623a-4a01-ad95-039c9e6afb23 tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.5e3de829-43ab-4035-aa78-20778b968d51" returned: 0 in 0.337s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:32 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-2ef50b47-623a-4a01-ad95-039c9e6afb23 tempest-SnapshotsActionsTest-45555313 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.5e3de829-43ab-4035-aa78-20778b968d51 is being set with open permissions: ugo+rw Sep 25 17:04:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2ef50b47-623a-4a01-ad95-039c9e6afb23 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.5e3de829-43ab-4035-aa78-20778b968d51 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:32 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.5e3de829-43ab-4035-aa78-20778b968d51 Sep 25 17:04:32 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:33 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2ef50b47-623a-4a01-ad95-039c9e6afb23 tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.5e3de829-43ab-4035-aa78-20778b968d51" returned: 0 in 0.368s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2ef50b47-623a-4a01-ad95-039c9e6afb23 tempest-SnapshotsActionsTest-45555313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.039s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:33 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-2ef50b47-623a-4a01-ad95-039c9e6afb23 tempest-SnapshotsActionsTest-45555313 None] Create snapshot completed successfully Sep 25 17:04:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] Acquiring lock "cinder-5e3de829-43ab-4035-aa78-20778b968d51-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-5e3de829-43ab-4035-aa78-20778b968d51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] Acquiring lock "cinder-quobyte-96acdd6e-c476-42d4-8251-216a62d8d7f0" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-quobyte-96acdd6e-c476-42d4-8251-216a62d8d7f0" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] Acquiring lock "cinder-quobyte-5e3de829-43ab-4035-aa78-20778b968d51" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-quobyte-5e3de829-43ab-4035-aa78-20778b968d51" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] Deleting offline snapshot 5e3de829-43ab-4035-aa78-20778b968d51 of volume 96acdd6e-c476-42d4-8251-216a62d8d7f0 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:04:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] snapshot_file for this snap is: volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.5e3de829-43ab-4035-aa78-20778b968d51 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:04:34 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3339cfb-ff59-4a36-9fd4-91b22905805c]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.5e3de829-43ab-4035-aa78-20778b968d51 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:34 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.5e3de829-43ab-4035-aa78-20778b968d51 Sep 25 17:04:34 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:35 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.5e3de829-43ab-4035-aa78-20778b968d51" returned: 0 in 0.479s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:35 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96acdd6e-c476-42d4-8251-216a62d8d7f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:04:35 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b535ff-324e-4467-8a21-d761aff8a7f0]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:35 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 Sep 25 17:04:35 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:35 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266" returned: 0 in 0.467s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:35 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96acdd6e-c476-42d4-8251-216a62d8d7f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:04:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.5e3de829-43ab-4035-aa78-20778b968d51 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:35 devstack sudo[88866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.5e3de829-43ab-4035-aa78-20778b968d51 Sep 25 17:04:35 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:36 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.5e3de829-43ab-4035-aa78-20778b968d51" returned: 0 in 0.573s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.5e3de829-43ab-4035-aa78-20778b968d51 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:36 devstack sudo[88872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.5e3de829-43ab-4035-aa78-20778b968d51 Sep 25 17:04:36 devstack sudo[88872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:36 devstack sudo[88872]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.5e3de829-43ab-4035-aa78-20778b968d51" returned: 0 in 0.300s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-quobyte-5e3de829-43ab-4035-aa78-20778b968d51" released by "_delete_snapshot" :: held 1.983s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-quobyte-96acdd6e-c476-42d4-8251-216a62d8d7f0" released by "delete_snapshot" :: held 2.033s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:36 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] Created reservations ['909dfbcc-6ca1-432d-931b-1275ab3508f2', 'bab5e066-5829-4b31-b9db-6e2880ab3316', '8ca15d42-dca0-4a38-9441-6b115f9fc7ca', 'adc8509a-e3ae-4863-a27c-d2f45490db93'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:04:36 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] Delete snapshot completed successfully. Sep 25 17:04:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-df263695-2e12-4db1-a4e3-0f4f886e70b6 tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-5e3de829-43ab-4035-aa78-20778b968d51-delete_snapshot" released by "delete_snapshot" :: held 2.273s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-752f33ed-af3c-4678-9174-46e5e445e45a tempest-SnapshotsActionsTest-45555313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-752f33ed-af3c-4678-9174-46e5e445e45a tempest-SnapshotsActionsTest-45555313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-752f33ed-af3c-4678-9174-46e5e445e45a tempest-SnapshotsActionsTest-45555313 None] Creating offline snapshot a5a47ed7-b69f-4c3e-9801-b18489b5db0f of volume 96acdd6e-c476-42d4-8251-216a62d8d7f0 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:04:38 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d88810-c27e-411d-a4be-df3a0867a7c0]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-752f33ed-af3c-4678-9174-46e5e445e45a tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:38 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 Sep 25 17:04:38 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:38 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-752f33ed-af3c-4678-9174-46e5e445e45a tempest-SnapshotsActionsTest-45555313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266" returned: 0 in 0.442s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-752f33ed-af3c-4678-9174-46e5e445e45a tempest-SnapshotsActionsTest-45555313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96acdd6e-c476-42d4-8251-216a62d8d7f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:04:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-752f33ed-af3c-4678-9174-46e5e445e45a tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a5a47ed7-b69f-4c3e-9801-b18489b5db0f 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:38 devstack sudo[88881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a5a47ed7-b69f-4c3e-9801-b18489b5db0f 1G Sep 25 17:04:38 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:39 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-752f33ed-af3c-4678-9174-46e5e445e45a tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a5a47ed7-b69f-4c3e-9801-b18489b5db0f 1G" returned: 0 in 0.611s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-752f33ed-af3c-4678-9174-46e5e445e45a tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a5a47ed7-b69f-4c3e-9801-b18489b5db0f {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:39 devstack sudo[88887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a5a47ed7-b69f-4c3e-9801-b18489b5db0f Sep 25 17:04:39 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:39 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-752f33ed-af3c-4678-9174-46e5e445e45a tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a5a47ed7-b69f-4c3e-9801-b18489b5db0f" returned: 0 in 0.385s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:39 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-752f33ed-af3c-4678-9174-46e5e445e45a tempest-SnapshotsActionsTest-45555313 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a5a47ed7-b69f-4c3e-9801-b18489b5db0f is being set with open permissions: ugo+rw Sep 25 17:04:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-752f33ed-af3c-4678-9174-46e5e445e45a tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a5a47ed7-b69f-4c3e-9801-b18489b5db0f {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:39 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a5a47ed7-b69f-4c3e-9801-b18489b5db0f Sep 25 17:04:39 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:40 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-752f33ed-af3c-4678-9174-46e5e445e45a tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a5a47ed7-b69f-4c3e-9801-b18489b5db0f" returned: 0 in 0.271s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-752f33ed-af3c-4678-9174-46e5e445e45a tempest-SnapshotsActionsTest-45555313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.830s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:40 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-752f33ed-af3c-4678-9174-46e5e445e45a tempest-SnapshotsActionsTest-45555313 None] Create snapshot completed successfully Sep 25 17:04:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] Acquiring lock "cinder-a5a47ed7-b69f-4c3e-9801-b18489b5db0f-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-a5a47ed7-b69f-4c3e-9801-b18489b5db0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] Acquiring lock "cinder-quobyte-96acdd6e-c476-42d4-8251-216a62d8d7f0" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-quobyte-96acdd6e-c476-42d4-8251-216a62d8d7f0" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] Acquiring lock "cinder-quobyte-a5a47ed7-b69f-4c3e-9801-b18489b5db0f" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-quobyte-a5a47ed7-b69f-4c3e-9801-b18489b5db0f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] Deleting offline snapshot a5a47ed7-b69f-4c3e-9801-b18489b5db0f of volume 96acdd6e-c476-42d4-8251-216a62d8d7f0 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:04:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] snapshot_file for this snap is: volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a5a47ed7-b69f-4c3e-9801-b18489b5db0f {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:04:40 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ddbff2-7eec-4691-ace5-8066d7b5adc5]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a5a47ed7-b69f-4c3e-9801-b18489b5db0f {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:40 devstack sudo[88902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a5a47ed7-b69f-4c3e-9801-b18489b5db0f Sep 25 17:04:40 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:40 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a5a47ed7-b69f-4c3e-9801-b18489b5db0f" returned: 0 in 0.396s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96acdd6e-c476-42d4-8251-216a62d8d7f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:04:41 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf140fce-84c0-4efd-8362-39320ffc64a4]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:41 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 Sep 25 17:04:41 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:41 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266" returned: 0 in 0.430s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96acdd6e-c476-42d4-8251-216a62d8d7f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:04:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a5a47ed7-b69f-4c3e-9801-b18489b5db0f {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:41 devstack sudo[88913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a5a47ed7-b69f-4c3e-9801-b18489b5db0f Sep 25 17:04:41 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:41 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a5a47ed7-b69f-4c3e-9801-b18489b5db0f" returned: 0 in 0.403s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a5a47ed7-b69f-4c3e-9801-b18489b5db0f {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:41 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a5a47ed7-b69f-4c3e-9801-b18489b5db0f Sep 25 17:04:41 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:42 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.a5a47ed7-b69f-4c3e-9801-b18489b5db0f" returned: 0 in 0.255s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-quobyte-a5a47ed7-b69f-4c3e-9801-b18489b5db0f" released by "_delete_snapshot" :: held 1.606s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-quobyte-96acdd6e-c476-42d4-8251-216a62d8d7f0" released by "delete_snapshot" :: held 1.630s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:42 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] Created reservations ['a617f75a-081b-4f48-bfec-50c6e65f6924', '64aebb1f-08b1-4497-a318-364feb30ba60', '995ee976-b2a4-44ff-b265-c8444f6cb4ff', '2781a06f-9f3e-4cd9-ab4e-29f5135821cc'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:04:42 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] Delete snapshot completed successfully. Sep 25 17:04:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-35e66f53-fc9f-4762-84cd-ddcebb025beb tempest-SnapshotsActionsTest-867689123 None] Lock "cinder-a5a47ed7-b69f-4c3e-9801-b18489b5db0f-delete_snapshot" released by "delete_snapshot" :: held 1.813s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-42c2d8e0-4b7d-49d0-82e7-aad232caca41 tempest-SnapshotsActionsTest-45555313 None] Acquiring lock "cinder-93f46bae-a3ee-4a9f-87e1-b2cb9ef81266-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-42c2d8e0-4b7d-49d0-82e7-aad232caca41 tempest-SnapshotsActionsTest-45555313 None] Lock "cinder-93f46bae-a3ee-4a9f-87e1-b2cb9ef81266-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-42c2d8e0-4b7d-49d0-82e7-aad232caca41 tempest-SnapshotsActionsTest-45555313 None] Acquiring lock "cinder-quobyte-96acdd6e-c476-42d4-8251-216a62d8d7f0" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-42c2d8e0-4b7d-49d0-82e7-aad232caca41 tempest-SnapshotsActionsTest-45555313 None] Lock "cinder-quobyte-96acdd6e-c476-42d4-8251-216a62d8d7f0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-42c2d8e0-4b7d-49d0-82e7-aad232caca41 tempest-SnapshotsActionsTest-45555313 None] Acquiring lock "cinder-quobyte-93f46bae-a3ee-4a9f-87e1-b2cb9ef81266" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-42c2d8e0-4b7d-49d0-82e7-aad232caca41 tempest-SnapshotsActionsTest-45555313 None] Lock "cinder-quobyte-93f46bae-a3ee-4a9f-87e1-b2cb9ef81266" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-42c2d8e0-4b7d-49d0-82e7-aad232caca41 tempest-SnapshotsActionsTest-45555313 None] Deleting offline snapshot 93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 of volume 96acdd6e-c476-42d4-8251-216a62d8d7f0 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:04:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-42c2d8e0-4b7d-49d0-82e7-aad232caca41 tempest-SnapshotsActionsTest-45555313 None] snapshot_file for this snap is: volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:04:43 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[245975b8-b179-46c4-a431-c912683fa8a7]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-42c2d8e0-4b7d-49d0-82e7-aad232caca41 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:43 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 Sep 25 17:04:43 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:43 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-42c2d8e0-4b7d-49d0-82e7-aad232caca41 tempest-SnapshotsActionsTest-45555313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266" returned: 0 in 0.421s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-42c2d8e0-4b7d-49d0-82e7-aad232caca41 tempest-SnapshotsActionsTest-45555313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96acdd6e-c476-42d4-8251-216a62d8d7f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:04:43 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ebf758-7472-4317-bdd2-0275e631d9af]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-42c2d8e0-4b7d-49d0-82e7-aad232caca41 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:43 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0 Sep 25 17:04:43 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:44 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-42c2d8e0-4b7d-49d0-82e7-aad232caca41 tempest-SnapshotsActionsTest-45555313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0" returned: 0 in 0.509s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-42c2d8e0-4b7d-49d0-82e7-aad232caca41 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:44 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 Sep 25 17:04:44 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:44 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-42c2d8e0-4b7d-49d0-82e7-aad232caca41 tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266" returned: 0 in 0.424s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-42c2d8e0-4b7d-49d0-82e7-aad232caca41 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:44 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266 Sep 25 17:04:44 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:45 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-42c2d8e0-4b7d-49d0-82e7-aad232caca41 tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0.93f46bae-a3ee-4a9f-87e1-b2cb9ef81266" returned: 0 in 0.322s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-42c2d8e0-4b7d-49d0-82e7-aad232caca41 tempest-SnapshotsActionsTest-45555313 None] Lock "cinder-quobyte-93f46bae-a3ee-4a9f-87e1-b2cb9ef81266" released by "_delete_snapshot" :: held 1.889s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-42c2d8e0-4b7d-49d0-82e7-aad232caca41 tempest-SnapshotsActionsTest-45555313 None] Lock "cinder-quobyte-96acdd6e-c476-42d4-8251-216a62d8d7f0" released by "delete_snapshot" :: held 1.921s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:45 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-42c2d8e0-4b7d-49d0-82e7-aad232caca41 tempest-SnapshotsActionsTest-45555313 None] Created reservations ['4a2f2fb8-d570-4b6e-928f-7598e766820e', '496003cb-cada-49ad-9970-d470bf2467d6', '3a89cfc8-21fd-4630-a78d-82bcfd7ee3e9', 'e3aa2bf5-8ebd-471f-bbfb-ac91962744f8'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:04:45 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-42c2d8e0-4b7d-49d0-82e7-aad232caca41 tempest-SnapshotsActionsTest-45555313 None] Delete snapshot completed successfully. Sep 25 17:04:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-42c2d8e0-4b7d-49d0-82e7-aad232caca41 tempest-SnapshotsActionsTest-45555313 None] Lock "cinder-93f46bae-a3ee-4a9f-87e1-b2cb9ef81266-delete_snapshot" released by "delete_snapshot" :: held 2.102s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-13a78cc6-959a-4f20-8342-a9946025bcc3 tempest-SnapshotsActionsTest-45555313 None] Acquiring lock "cinder-96acdd6e-c476-42d4-8251-216a62d8d7f0-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-13a78cc6-959a-4f20-8342-a9946025bcc3 tempest-SnapshotsActionsTest-45555313 None] Lock "cinder-96acdd6e-c476-42d4-8251-216a62d8d7f0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-13a78cc6-959a-4f20-8342-a9946025bcc3 tempest-SnapshotsActionsTest-45555313 None] Acquiring lock "cinder-quobyte-96acdd6e-c476-42d4-8251-216a62d8d7f0" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-13a78cc6-959a-4f20-8342-a9946025bcc3 tempest-SnapshotsActionsTest-45555313 None] Lock "cinder-quobyte-96acdd6e-c476-42d4-8251-216a62d8d7f0" acquired by "delete_volume" :: waited 0.021s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:45 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb1f1bb-692e-4d93-8a16-140bd3f418b2]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-13a78cc6-959a-4f20-8342-a9946025bcc3 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:45 devstack sudo[88941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0 Sep 25 17:04:45 devstack sudo[88941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:46 devstack sudo[88941]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-13a78cc6-959a-4f20-8342-a9946025bcc3 tempest-SnapshotsActionsTest-45555313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0" returned: 0 in 0.462s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-13a78cc6-959a-4f20-8342-a9946025bcc3 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:46 devstack sudo[88947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0 Sep 25 17:04:46 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:46 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-13a78cc6-959a-4f20-8342-a9946025bcc3 tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-96acdd6e-c476-42d4-8251-216a62d8d7f0" returned: 0 in 0.287s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:46 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-13a78cc6-959a-4f20-8342-a9946025bcc3 tempest-SnapshotsActionsTest-45555313 None] Lock "cinder-quobyte-96acdd6e-c476-42d4-8251-216a62d8d7f0" released by "delete_volume" :: held 0.833s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:46 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-13a78cc6-959a-4f20-8342-a9946025bcc3 tempest-SnapshotsActionsTest-45555313 None] Created reservations ['1d086b90-7281-44a9-8fcd-b4663bf095e1', '4827fc20-3e8f-492f-97cb-84c507a8753c', 'd0d5bd58-ff02-44b7-afe6-9ad6c8a803ff', '7ab8f19e-7d86-4b3a-b6c9-ad5a8f435968'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:04:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-13a78cc6-959a-4f20-8342-a9946025bcc3 tempest-SnapshotsActionsTest-45555313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-13a78cc6-959a-4f20-8342-a9946025bcc3 tempest-SnapshotsActionsTest-45555313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:46 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-13a78cc6-959a-4f20-8342-a9946025bcc3 tempest-SnapshotsActionsTest-45555313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:04:46 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-13a78cc6-959a-4f20-8342-a9946025bcc3 tempest-SnapshotsActionsTest-45555313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:04:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-13a78cc6-959a-4f20-8342-a9946025bcc3 tempest-SnapshotsActionsTest-45555313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-13a78cc6-959a-4f20-8342-a9946025bcc3 tempest-SnapshotsActionsTest-45555313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:46 devstack sudo[88950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:04:46 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:46 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-13a78cc6-959a-4f20-8342-a9946025bcc3 tempest-SnapshotsActionsTest-45555313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.350s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:46 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-13a78cc6-959a-4f20-8342-a9946025bcc3 tempest-SnapshotsActionsTest-45555313 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:04:46 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-13a78cc6-959a-4f20-8342-a9946025bcc3 tempest-SnapshotsActionsTest-45555313 None] Deleted volume successfully. Sep 25 17:04:46 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-13a78cc6-959a-4f20-8342-a9946025bcc3 tempest-SnapshotsActionsTest-45555313 None] Lock "cinder-96acdd6e-c476-42d4-8251-216a62d8d7f0-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:04:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:04:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:04:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:53 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:04:53 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:53 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.319s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:53 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:04:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:04:53 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 8 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:04:53 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:04:56 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=68,cinder:UPDATE=65,cinder:INSERT=21,cinder:DELETE=5 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:04:56 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:UPDATE=70,cinder:SELECT=63,cinder:DELETE=6,cinder:INSERT=15 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:05:16 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:05:41 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:05:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Flow 'volume_create_manager' (689b80eb-eba9-4757-be19-55378dc06eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:05:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af538f81-bcbd-4496-aa52-b4c964ea55ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af538f81-bcbd-4496-aa52-b4c964ea55ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1316079057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7e6725-76fc-4c35-8786-5a643ef21455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baaa0129ae73454da29a35b1510cdd9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:41Z,use_quota=True,user_id='3c26d0aaeaea40dbbac521845cc08397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60fe01df-e753-4c72-b1a5-e181cdee81b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60fe01df-e753-4c72-b1a5-e181cdee81b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f41e69-97f2-4537-adc1-786d0f4c94e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f41e69-97f2-4537-adc1-786d0f4c94e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c7e6725-76fc-4c35-8786-5a643ef21455', 'volume_name': 'volume-6c7e6725-76fc-4c35-8786-5a643ef21455', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191f9732-7684-42a0-aece-f0bebfe2c979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191f9732-7684-42a0-aece-f0bebfe2c979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd5bfa1-54ed-4647-8a07-1e0f2435e274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:41 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Volume 6c7e6725-76fc-4c35-8786-5a643ef21455: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c7e6725-76fc-4c35-8786-5a643ef21455', 'volume_size': 1} Sep 25 17:05:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1316079057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7e6725-76fc-4c35-8786-5a643ef21455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baaa0129ae73454da29a35b1510cdd9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:41Z,use_quota=True,user_id='3c26d0aaeaea40dbbac521845cc08397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:05:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Creating volume 6c7e6725-76fc-4c35-8786-5a643ef21455 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:05:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:05:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:05:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:05:41 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:05:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6c7e6725-76fc-4c35-8786-5a643ef21455 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:41 devstack sudo[89422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6c7e6725-76fc-4c35-8786-5a643ef21455 1073741824 Sep 25 17:05:41 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:42 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6c7e6725-76fc-4c35-8786-5a643ef21455 1073741824" returned: 0 in 0.763s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6c7e6725-76fc-4c35-8786-5a643ef21455 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:42 devstack sudo[89428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6c7e6725-76fc-4c35-8786-5a643ef21455 Sep 25 17:05:42 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:42 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6c7e6725-76fc-4c35-8786-5a643ef21455" returned: 0 in 0.457s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:05:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd5bfa1-54ed-4647-8a07-1e0f2435e274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c7e6725-76fc-4c35-8786-5a643ef21455', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29c190b-1245-49a1-a987-0bbb5e54be44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:42 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Volume volume-6c7e6725-76fc-4c35-8786-5a643ef21455 (6c7e6725-76fc-4c35-8786-5a643ef21455): created successfully Sep 25 17:05:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29c190b-1245-49a1-a987-0bbb5e54be44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Flow 'volume_create_manager' (689b80eb-eba9-4757-be19-55378dc06eb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:05:43 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-191119a7-8f68-4d7b-9c7b-82a43bd8f500 tempest-ServersNegativeTestJSON-872444018 None] Created volume successfully. Sep 25 17:05:45 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:05:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Flow 'volume_create_manager' (4593f4db-3fc5-4dd5-8472-dd26cd8e11eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:05:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505ae1cc-0781-4710-82a3-2b5439da0ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505ae1cc-0781-4710-82a3-2b5439da0ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-452571601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe3d1f17-0ca2-4009-971b-bd622a5e0354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5354770568624a06b3ce8e055e20e91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:46Z,use_quota=True,user_id='e06666017f604b0e8438ffc24e236a71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d23818-7b69-43bb-996a-e3954da5f698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d23818-7b69-43bb-996a-e3954da5f698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d76a05-2b64-4efa-9524-4749047c8a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d76a05-2b64-4efa-9524-4749047c8a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe3d1f17-0ca2-4009-971b-bd622a5e0354', 'volume_name': 'volume-fe3d1f17-0ca2-4009-971b-bd622a5e0354', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5560a345-6225-448a-af38-2189408c3c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5560a345-6225-448a-af38-2189408c3c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d5b555-32ec-4c37-867d-f63fd8238f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:45 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Volume fe3d1f17-0ca2-4009-971b-bd622a5e0354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe3d1f17-0ca2-4009-971b-bd622a5e0354', 'volume_size': 1} Sep 25 17:05:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-452571601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe3d1f17-0ca2-4009-971b-bd622a5e0354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5354770568624a06b3ce8e055e20e91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:46Z,use_quota=True,user_id='e06666017f604b0e8438ffc24e236a71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:05:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Creating volume fe3d1f17-0ca2-4009-971b-bd622a5e0354 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:05:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:05:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:05:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:05:45 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:05:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fe3d1f17-0ca2-4009-971b-bd622a5e0354 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:45 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fe3d1f17-0ca2-4009-971b-bd622a5e0354 1073741824 Sep 25 17:05:45 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:46 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fe3d1f17-0ca2-4009-971b-bd622a5e0354 1073741824" returned: 0 in 0.588s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fe3d1f17-0ca2-4009-971b-bd622a5e0354 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:46 devstack sudo[89441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fe3d1f17-0ca2-4009-971b-bd622a5e0354 Sep 25 17:05:46 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:46 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fe3d1f17-0ca2-4009-971b-bd622a5e0354" returned: 0 in 0.304s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:46 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:05:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d5b555-32ec-4c37-867d-f63fd8238f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe3d1f17-0ca2-4009-971b-bd622a5e0354', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341c756b-6f8d-4250-8a09-2b578b8de4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:46 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Volume volume-fe3d1f17-0ca2-4009-971b-bd622a5e0354 (fe3d1f17-0ca2-4009-971b-bd622a5e0354): created successfully Sep 25 17:05:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341c756b-6f8d-4250-8a09-2b578b8de4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Flow 'volume_create_manager' (4593f4db-3fc5-4dd5-8472-dd26cd8e11eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:05:46 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-f7d9b484-0eae-4b9f-b0d2-7c7f4e562711 tempest-ServerActionsTestOtherA-902126569 None] Created volume successfully. Sep 25 17:05:50 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:05:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Flow 'volume_create_manager' (b9357b15-b27a-4529-86f9-8277ee983ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:05:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58472aba-7cd2-4bec-9da7-3ae65f465b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58472aba-7cd2-4bec-9da7-3ae65f465b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1630929898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65cd7a42-d436-4e7d-b668-3bc926582b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baaa0129ae73454da29a35b1510cdd9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:50Z,use_quota=True,user_id='3c26d0aaeaea40dbbac521845cc08397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec68866-4afc-46e0-acb2-8f3f51bca94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec68866-4afc-46e0-acb2-8f3f51bca94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e65e66-8972-490b-8d20-715f32cca885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e65e66-8972-490b-8d20-715f32cca885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65cd7a42-d436-4e7d-b668-3bc926582b54', 'volume_name': 'volume-65cd7a42-d436-4e7d-b668-3bc926582b54', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2557ec3-77af-4a29-b2c0-e91e07327a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2557ec3-77af-4a29-b2c0-e91e07327a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d6f083-c49a-4884-a033-e8b2ea412559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:50 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Volume 65cd7a42-d436-4e7d-b668-3bc926582b54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65cd7a42-d436-4e7d-b668-3bc926582b54', 'volume_size': 1} Sep 25 17:05:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1630929898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65cd7a42-d436-4e7d-b668-3bc926582b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baaa0129ae73454da29a35b1510cdd9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:50Z,use_quota=True,user_id='3c26d0aaeaea40dbbac521845cc08397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:05:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Creating volume 65cd7a42-d436-4e7d-b668-3bc926582b54 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:05:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:05:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:05:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:05:50 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:05:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-65cd7a42-d436-4e7d-b668-3bc926582b54 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:50 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-65cd7a42-d436-4e7d-b668-3bc926582b54 1073741824 Sep 25 17:05:50 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:51 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-65cd7a42-d436-4e7d-b668-3bc926582b54 1073741824" returned: 0 in 0.650s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-65cd7a42-d436-4e7d-b668-3bc926582b54 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:51 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-65cd7a42-d436-4e7d-b668-3bc926582b54 Sep 25 17:05:51 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:51 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-65cd7a42-d436-4e7d-b668-3bc926582b54" returned: 0 in 0.313s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:05:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d6f083-c49a-4884-a033-e8b2ea412559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65cd7a42-d436-4e7d-b668-3bc926582b54', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d426f826-7823-424a-9742-2dda678a9ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:51 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Volume volume-65cd7a42-d436-4e7d-b668-3bc926582b54 (65cd7a42-d436-4e7d-b668-3bc926582b54): created successfully Sep 25 17:05:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d426f826-7823-424a-9742-2dda678a9ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Flow 'volume_create_manager' (b9357b15-b27a-4529-86f9-8277ee983ddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:05:51 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-16034bd6-8b79-4453-96c6-3543f078788d tempest-ServersNegativeTestJSON-872444018 None] Created volume successfully. Sep 25 17:05:52 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:05:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Flow 'volume_create_manager' (5d71c75d-901d-466c-96db-d133eff41756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:05:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08fdd775-416c-44e0-aae3-e1c23527aaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08fdd775-416c-44e0-aae3-e1c23527aaef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2106598691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cbf602f-ccc6-44d1-bb61-a534be63a4b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ae0d94b94ae478793a6e3f9388969ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:53Z,use_quota=True,user_id='c9dfdadb8ae14f508b0294484dc4e2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70e4853-c481-4655-a0ea-e07b6513a89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70e4853-c481-4655-a0ea-e07b6513a89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a62d01-8fd3-4d4c-b1af-8da313678029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a62d01-8fd3-4d4c-b1af-8da313678029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cbf602f-ccc6-44d1-bb61-a534be63a4b8', 'volume_name': 'volume-4cbf602f-ccc6-44d1-bb61-a534be63a4b8', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33db0251-d71f-4658-bfe6-695a56c6a082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33db0251-d71f-4658-bfe6-695a56c6a082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be2a5a4-f0dd-4984-815b-68014d165c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:52 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Volume 4cbf602f-ccc6-44d1-bb61-a534be63a4b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cbf602f-ccc6-44d1-bb61-a534be63a4b8', 'volume_size': 1} Sep 25 17:05:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:52 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2106598691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cbf602f-ccc6-44d1-bb61-a534be63a4b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ae0d94b94ae478793a6e3f9388969ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:53Z,use_quota=True,user_id='c9dfdadb8ae14f508b0294484dc4e2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:05:52 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Creating volume 4cbf602f-ccc6-44d1-bb61-a534be63a4b8 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:05:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:52 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:05:52 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:05:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:52 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:05:52 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:05:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4cbf602f-ccc6-44d1-bb61-a534be63a4b8 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:52 devstack sudo[89456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4cbf602f-ccc6-44d1-bb61-a534be63a4b8 1073741824 Sep 25 17:05:52 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:53 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4cbf602f-ccc6-44d1-bb61-a534be63a4b8 1073741824" returned: 0 in 0.566s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4cbf602f-ccc6-44d1-bb61-a534be63a4b8 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:53 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4cbf602f-ccc6-44d1-bb61-a534be63a4b8 Sep 25 17:05:53 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:05:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:05:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:05:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:53 devstack sudo[89464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:05:53 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:53 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4cbf602f-ccc6-44d1-bb61-a534be63a4b8" returned: 0 in 0.414s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:05:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:53 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be2a5a4-f0dd-4984-815b-68014d165c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cbf602f-ccc6-44d1-bb61-a534be63a4b8', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:53 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a8ba4d-80de-4137-8c10-de7c2d9f80a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:54 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Volume volume-4cbf602f-ccc6-44d1-bb61-a534be63a4b8 (4cbf602f-ccc6-44d1-bb61-a534be63a4b8): created successfully Sep 25 17:05:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a8ba4d-80de-4137-8c10-de7c2d9f80a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:54 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Flow 'volume_create_manager' (5d71c75d-901d-466c-96db-d133eff41756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:05:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.409s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:54 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:05:54 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:05:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 8 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:05:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:05:54 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-094a2118-6bc2-4c6d-8cde-d2138fb9d7f4 tempest-TaggedAttachmentsTest-685504623 None] Created volume successfully. Sep 25 17:05:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ed6d4fa3-4b57-4b5b-9aa1-d92164689ea2 tempest-ServersNegativeTestJSON-872444018 None] Acquiring lock "cinder-65cd7a42-d436-4e7d-b668-3bc926582b54-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:05:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ed6d4fa3-4b57-4b5b-9aa1-d92164689ea2 tempest-ServersNegativeTestJSON-872444018 None] Lock "cinder-65cd7a42-d436-4e7d-b668-3bc926582b54-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:05:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ed6d4fa3-4b57-4b5b-9aa1-d92164689ea2 tempest-ServersNegativeTestJSON-872444018 None] Acquiring lock "cinder-quobyte-65cd7a42-d436-4e7d-b668-3bc926582b54" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:05:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ed6d4fa3-4b57-4b5b-9aa1-d92164689ea2 tempest-ServersNegativeTestJSON-872444018 None] Lock "cinder-quobyte-65cd7a42-d436-4e7d-b668-3bc926582b54" acquired by "delete_volume" :: waited 0.036s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:05:54 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[3205b09d-a0fb-4f4a-a9fa-f92a5c96b53e]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:05:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ed6d4fa3-4b57-4b5b-9aa1-d92164689ea2 tempest-ServersNegativeTestJSON-872444018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-65cd7a42-d436-4e7d-b668-3bc926582b54 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:54 devstack sudo[89468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-65cd7a42-d436-4e7d-b668-3bc926582b54 Sep 25 17:05:54 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:55 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ed6d4fa3-4b57-4b5b-9aa1-d92164689ea2 tempest-ServersNegativeTestJSON-872444018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-65cd7a42-d436-4e7d-b668-3bc926582b54" returned: 0 in 0.547s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ed6d4fa3-4b57-4b5b-9aa1-d92164689ea2 tempest-ServersNegativeTestJSON-872444018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-65cd7a42-d436-4e7d-b668-3bc926582b54 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:55 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-65cd7a42-d436-4e7d-b668-3bc926582b54 Sep 25 17:05:55 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:55 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ed6d4fa3-4b57-4b5b-9aa1-d92164689ea2 tempest-ServersNegativeTestJSON-872444018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-65cd7a42-d436-4e7d-b668-3bc926582b54" returned: 0 in 0.460s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ed6d4fa3-4b57-4b5b-9aa1-d92164689ea2 tempest-ServersNegativeTestJSON-872444018 None] Lock "cinder-quobyte-65cd7a42-d436-4e7d-b668-3bc926582b54" released by "delete_volume" :: held 1.105s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:05:55 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-ed6d4fa3-4b57-4b5b-9aa1-d92164689ea2 tempest-ServersNegativeTestJSON-872444018 None] Created reservations ['402f835e-da9c-4d61-a6d6-68c0409009d7', '1e4ddf88-d022-4eb4-b6ac-d755c566aece', '4b635692-edc0-433f-a4e9-d1c05bd216f0', '20be0481-a63a-467b-9678-923726a92d63'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:05:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ed6d4fa3-4b57-4b5b-9aa1-d92164689ea2 tempest-ServersNegativeTestJSON-872444018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ed6d4fa3-4b57-4b5b-9aa1-d92164689ea2 tempest-ServersNegativeTestJSON-872444018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ed6d4fa3-4b57-4b5b-9aa1-d92164689ea2 tempest-ServersNegativeTestJSON-872444018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:05:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ed6d4fa3-4b57-4b5b-9aa1-d92164689ea2 tempest-ServersNegativeTestJSON-872444018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:05:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ed6d4fa3-4b57-4b5b-9aa1-d92164689ea2 tempest-ServersNegativeTestJSON-872444018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ed6d4fa3-4b57-4b5b-9aa1-d92164689ea2 tempest-ServersNegativeTestJSON-872444018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:56 devstack sudo[89481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:05:56 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:56 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ed6d4fa3-4b57-4b5b-9aa1-d92164689ea2 tempest-ServersNegativeTestJSON-872444018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.349s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:56 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-ed6d4fa3-4b57-4b5b-9aa1-d92164689ea2 tempest-ServersNegativeTestJSON-872444018 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:05:56 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-ed6d4fa3-4b57-4b5b-9aa1-d92164689ea2 tempest-ServersNegativeTestJSON-872444018 None] Deleted volume successfully. Sep 25 17:05:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ed6d4fa3-4b57-4b5b-9aa1-d92164689ea2 tempest-ServersNegativeTestJSON-872444018 None] Lock "cinder-65cd7a42-d436-4e7d-b668-3bc926582b54-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:05:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1b1c832d-ebb2-4dce-a82d-17fb2f729e6b tempest-ServersNegativeTestJSON-872444018 None] Acquiring lock "cinder-6c7e6725-76fc-4c35-8786-5a643ef21455-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:05:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1b1c832d-ebb2-4dce-a82d-17fb2f729e6b tempest-ServersNegativeTestJSON-872444018 None] Lock "cinder-6c7e6725-76fc-4c35-8786-5a643ef21455-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:05:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1b1c832d-ebb2-4dce-a82d-17fb2f729e6b tempest-ServersNegativeTestJSON-872444018 None] Acquiring lock "cinder-quobyte-6c7e6725-76fc-4c35-8786-5a643ef21455" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:05:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1b1c832d-ebb2-4dce-a82d-17fb2f729e6b tempest-ServersNegativeTestJSON-872444018 None] Lock "cinder-quobyte-6c7e6725-76fc-4c35-8786-5a643ef21455" acquired by "delete_volume" :: waited 0.029s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:05:57 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cbb78c-e2aa-4124-a797-85d1c40353cd]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:05:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1b1c832d-ebb2-4dce-a82d-17fb2f729e6b tempest-ServersNegativeTestJSON-872444018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6c7e6725-76fc-4c35-8786-5a643ef21455 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:57 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6c7e6725-76fc-4c35-8786-5a643ef21455 Sep 25 17:05:57 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:57 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1b1c832d-ebb2-4dce-a82d-17fb2f729e6b tempest-ServersNegativeTestJSON-872444018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6c7e6725-76fc-4c35-8786-5a643ef21455" returned: 0 in 0.573s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1b1c832d-ebb2-4dce-a82d-17fb2f729e6b tempest-ServersNegativeTestJSON-872444018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6c7e6725-76fc-4c35-8786-5a643ef21455 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:57 devstack sudo[89496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6c7e6725-76fc-4c35-8786-5a643ef21455 Sep 25 17:05:57 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:58 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1b1c832d-ebb2-4dce-a82d-17fb2f729e6b tempest-ServersNegativeTestJSON-872444018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6c7e6725-76fc-4c35-8786-5a643ef21455" returned: 0 in 0.583s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1b1c832d-ebb2-4dce-a82d-17fb2f729e6b tempest-ServersNegativeTestJSON-872444018 None] Lock "cinder-quobyte-6c7e6725-76fc-4c35-8786-5a643ef21455" released by "delete_volume" :: held 1.232s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:05:58 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-1b1c832d-ebb2-4dce-a82d-17fb2f729e6b tempest-ServersNegativeTestJSON-872444018 None] Created reservations ['6861104b-1ec4-48ba-9008-29172a7431f5', 'f3784e14-1c87-40bc-be9b-8a0f534a6c8d', '45b475ba-3b1a-4cb7-9f72-2346b61fe6ba', 'b70b1c33-547b-4707-8593-8229c1f6cf55'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:05:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1b1c832d-ebb2-4dce-a82d-17fb2f729e6b tempest-ServersNegativeTestJSON-872444018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1b1c832d-ebb2-4dce-a82d-17fb2f729e6b tempest-ServersNegativeTestJSON-872444018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:58 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1b1c832d-ebb2-4dce-a82d-17fb2f729e6b tempest-ServersNegativeTestJSON-872444018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:05:58 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1b1c832d-ebb2-4dce-a82d-17fb2f729e6b tempest-ServersNegativeTestJSON-872444018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:05:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1b1c832d-ebb2-4dce-a82d-17fb2f729e6b tempest-ServersNegativeTestJSON-872444018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1b1c832d-ebb2-4dce-a82d-17fb2f729e6b tempest-ServersNegativeTestJSON-872444018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:58 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:05:58 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:59 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1b1c832d-ebb2-4dce-a82d-17fb2f729e6b tempest-ServersNegativeTestJSON-872444018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.512s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:59 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-1b1c832d-ebb2-4dce-a82d-17fb2f729e6b tempest-ServersNegativeTestJSON-872444018 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:05:59 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-1b1c832d-ebb2-4dce-a82d-17fb2f729e6b tempest-ServersNegativeTestJSON-872444018 None] Deleted volume successfully. Sep 25 17:05:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1b1c832d-ebb2-4dce-a82d-17fb2f729e6b tempest-ServersNegativeTestJSON-872444018 None] Lock "cinder-6c7e6725-76fc-4c35-8786-5a643ef21455-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:08 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:UPDATE=28,cinder:SELECT=17,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:06:09 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=19,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=5 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:06:12 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:06:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Flow 'volume_create_manager' (4384a565-77ce-4ee4-8931-f9064a4c9af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:06:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b16a89-7839-45c3-bca0-f10675f75c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b16a89-7839-45c3-bca0-f10675f75c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-270415642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5e936f-8ecd-43b6-8f2b-ec7013ebebb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88bfcb357b64d8e8cb4e77595c34481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:13Z,use_quota=True,user_id='8d50c92913ed4f10b019405592799f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241a541b-4bd3-43eb-95ec-5e47ccb0c924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241a541b-4bd3-43eb-95ec-5e47ccb0c924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973d6e16-e6a7-42ee-8a44-827d77d0aa78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973d6e16-e6a7-42ee-8a44-827d77d0aa78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da5e936f-8ecd-43b6-8f2b-ec7013ebebb2', 'volume_name': 'volume-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20013c24-07d8-4a4e-a483-ac62e68d0932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20013c24-07d8-4a4e-a483-ac62e68d0932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e1dfea-5947-49d2-8f3c-0e23d20dd41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:12 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Volume da5e936f-8ecd-43b6-8f2b-ec7013ebebb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2', 'volume_size': 1} Sep 25 17:06:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-270415642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5e936f-8ecd-43b6-8f2b-ec7013ebebb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88bfcb357b64d8e8cb4e77595c34481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:13Z,use_quota=True,user_id='8d50c92913ed4f10b019405592799f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:06:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Creating volume da5e936f-8ecd-43b6-8f2b-ec7013ebebb2 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:06:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:06:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:06:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:06:12 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:06:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:12 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2 1073741824 Sep 25 17:06:12 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:13 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2 1073741824" returned: 0 in 0.683s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:13 devstack sudo[89747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2 Sep 25 17:06:13 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:14 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2" returned: 0 in 0.487s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:06:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e1dfea-5947-49d2-8f3c-0e23d20dd41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537140b1-82d4-44ac-be60-48fb2bd6d90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:14 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Volume volume-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2 (da5e936f-8ecd-43b6-8f2b-ec7013ebebb2): created successfully Sep 25 17:06:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537140b1-82d4-44ac-be60-48fb2bd6d90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Flow 'volume_create_manager' (4384a565-77ce-4ee4-8931-f9064a4c9af9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:06:14 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-6a6bd964-7acb-4142-a0cb-0ed55831b16a tempest-VolumesActionsTest-1296066307 None] Created volume successfully. Sep 25 17:06:15 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-29fe6fe9-e814-4a9f-9d73-33e3a6c118b6 tempest-VolumesActionsTest-1296066307 None] Acquiring lock "cinder-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2" by "attach_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:15 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-29fe6fe9-e814-4a9f-9d73-33e3a6c118b6 tempest-VolumesActionsTest-1296066307 None] Lock "cinder-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2" acquired by "attach_volume" :: waited 0.075s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:15 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-29fe6fe9-e814-4a9f-9d73-33e3a6c118b6 tempest-VolumesActionsTest-1296066307 None] Attaching volume da5e936f-8ecd-43b6-8f2b-ec7013ebebb2 to instance 3b9036b0-4928-4530-8faf-fd88a0c1a79a at mountpoint /dev/vdb on host None. Sep 25 17:06:15 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-29fe6fe9-e814-4a9f-9d73-33e3a6c118b6 tempest-VolumesActionsTest-1296066307 None] Attach volume completed successfully. Sep 25 17:06:15 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-29fe6fe9-e814-4a9f-9d73-33e3a6c118b6 tempest-VolumesActionsTest-1296066307 None] Lock "cinder-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2" released by "attach_volume" :: held 0.434s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:17 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-9116e70b-2afc-4e40-a413-0328f05adcb4 tempest-VolumesActionsTest-337222283 None] Terminate volume connection completed successfully. Sep 25 17:06:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9116e70b-2afc-4e40-a413-0328f05adcb4 tempest-VolumesActionsTest-337222283 None] Acquiring lock "cinder-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2-detach_volume" by "detach_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9116e70b-2afc-4e40-a413-0328f05adcb4 tempest-VolumesActionsTest-337222283 None] Lock "cinder-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2-detach_volume" acquired by "detach_volume" :: waited 0.061s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:17 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-9116e70b-2afc-4e40-a413-0328f05adcb4 tempest-VolumesActionsTest-337222283 None] Detaching volume da5e936f-8ecd-43b6-8f2b-ec7013ebebb2 from instance 3b9036b0-4928-4530-8faf-fd88a0c1a79a. Sep 25 17:06:18 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-9116e70b-2afc-4e40-a413-0328f05adcb4 tempest-VolumesActionsTest-337222283 None] Detach volume completed successfully. Sep 25 17:06:18 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9116e70b-2afc-4e40-a413-0328f05adcb4 tempest-VolumesActionsTest-337222283 None] Lock "cinder-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2-detach_volume" released by "detach_volume" :: held 0.214s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:18 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e3b24734-a248-4b6c-883f-374c365eaad8 tempest-VolumesActionsTest-1296066307 None] Acquiring lock "cinder-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2-detach_volume" by "detach_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:18 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e3b24734-a248-4b6c-883f-374c365eaad8 tempest-VolumesActionsTest-1296066307 None] Lock "cinder-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:18 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-e3b24734-a248-4b6c-883f-374c365eaad8 tempest-VolumesActionsTest-1296066307 None] Volume detach called, but volume not attached. Sep 25 17:06:18 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e3b24734-a248-4b6c-883f-374c365eaad8 tempest-VolumesActionsTest-1296066307 None] Lock "cinder-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2-detach_volume" released by "detach_volume" :: held 0.039s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:18 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6f37328a-4e93-4be6-9d1a-e8fc9f5e3a26 tempest-VolumesActionsTest-1296066307 None] Acquiring lock "cinder-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:18 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6f37328a-4e93-4be6-9d1a-e8fc9f5e3a26 tempest-VolumesActionsTest-1296066307 None] Lock "cinder-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:18 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6f37328a-4e93-4be6-9d1a-e8fc9f5e3a26 tempest-VolumesActionsTest-1296066307 None] Acquiring lock "cinder-quobyte-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6f37328a-4e93-4be6-9d1a-e8fc9f5e3a26 tempest-VolumesActionsTest-1296066307 None] Lock "cinder-quobyte-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2" acquired by "delete_volume" :: waited 0.045s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:19 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9437cff7-4084-47f8-995b-7f7dc7c258a0]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:06:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6f37328a-4e93-4be6-9d1a-e8fc9f5e3a26 tempest-VolumesActionsTest-1296066307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:19 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2 Sep 25 17:06:19 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:19 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6f37328a-4e93-4be6-9d1a-e8fc9f5e3a26 tempest-VolumesActionsTest-1296066307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2" returned: 0 in 0.726s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6f37328a-4e93-4be6-9d1a-e8fc9f5e3a26 tempest-VolumesActionsTest-1296066307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:19 devstack sudo[89845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2 Sep 25 17:06:19 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:20 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6f37328a-4e93-4be6-9d1a-e8fc9f5e3a26 tempest-VolumesActionsTest-1296066307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2" returned: 0 in 0.565s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:20 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6f37328a-4e93-4be6-9d1a-e8fc9f5e3a26 tempest-VolumesActionsTest-1296066307 None] Lock "cinder-quobyte-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2" released by "delete_volume" :: held 1.411s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:20 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-6f37328a-4e93-4be6-9d1a-e8fc9f5e3a26 tempest-VolumesActionsTest-1296066307 None] Created reservations ['99afd17e-6cae-46fb-81b4-1b7ac6ccdb27', 'bd76b841-5e26-43c6-9a4f-4306986b233b', 'dc2f1b60-a3ae-435d-996e-8386a4b60bef', '291d345b-8071-401d-b54c-abd01eb630df'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:06:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6f37328a-4e93-4be6-9d1a-e8fc9f5e3a26 tempest-VolumesActionsTest-1296066307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6f37328a-4e93-4be6-9d1a-e8fc9f5e3a26 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:20 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6f37328a-4e93-4be6-9d1a-e8fc9f5e3a26 tempest-VolumesActionsTest-1296066307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:06:20 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6f37328a-4e93-4be6-9d1a-e8fc9f5e3a26 tempest-VolumesActionsTest-1296066307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:06:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6f37328a-4e93-4be6-9d1a-e8fc9f5e3a26 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6f37328a-4e93-4be6-9d1a-e8fc9f5e3a26 tempest-VolumesActionsTest-1296066307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:21 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:06:21 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:21 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6f37328a-4e93-4be6-9d1a-e8fc9f5e3a26 tempest-VolumesActionsTest-1296066307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.693s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:21 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-6f37328a-4e93-4be6-9d1a-e8fc9f5e3a26 tempest-VolumesActionsTest-1296066307 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:06:21 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-6f37328a-4e93-4be6-9d1a-e8fc9f5e3a26 tempest-VolumesActionsTest-1296066307 None] Deleted volume successfully. Sep 25 17:06:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6f37328a-4e93-4be6-9d1a-e8fc9f5e3a26 tempest-VolumesActionsTest-1296066307 None] Lock "cinder-da5e936f-8ecd-43b6-8f2b-ec7013ebebb2-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:23 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:06:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Flow 'volume_create_manager' (590dd9ec-d3c5-4837-9214-f418a9288e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:06:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a163abf6-b7da-41e2-807b-196055eeb2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a163abf6-b7da-41e2-807b-196055eeb2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1180505900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=170ffd44-74bf-44d0-8c5c-4ff7796bc271,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25bdd789ff994666a40a24c2d23e3ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:23Z,use_quota=True,user_id='83b3c7d006cb451f8b1d18dcef93f2db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf5e254a-8c66-4e36-ae02-49b1c8b3afee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf5e254a-8c66-4e36-ae02-49b1c8b3afee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8831d761-d20e-4507-883e-c0486d91577c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8831d761-d20e-4507-883e-c0486d91577c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '170ffd44-74bf-44d0-8c5c-4ff7796bc271', 'volume_name': 'volume-170ffd44-74bf-44d0-8c5c-4ff7796bc271', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9df6d7-7cec-46dd-b387-5b569be1155e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9df6d7-7cec-46dd-b387-5b569be1155e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b0cc93-410c-4552-a329-6617433a45f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:23 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Volume 170ffd44-74bf-44d0-8c5c-4ff7796bc271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-170ffd44-74bf-44d0-8c5c-4ff7796bc271', 'volume_size': 1} Sep 25 17:06:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1180505900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=170ffd44-74bf-44d0-8c5c-4ff7796bc271,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25bdd789ff994666a40a24c2d23e3ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:23Z,use_quota=True,user_id='83b3c7d006cb451f8b1d18dcef93f2db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:06:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Creating volume 170ffd44-74bf-44d0-8c5c-4ff7796bc271 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:06:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:06:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:06:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:06:23 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:06:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-170ffd44-74bf-44d0-8c5c-4ff7796bc271 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:23 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-170ffd44-74bf-44d0-8c5c-4ff7796bc271 1073741824 Sep 25 17:06:23 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:24 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-170ffd44-74bf-44d0-8c5c-4ff7796bc271 1073741824" returned: 0 in 1.068s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-170ffd44-74bf-44d0-8c5c-4ff7796bc271 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:24 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-170ffd44-74bf-44d0-8c5c-4ff7796bc271 Sep 25 17:06:24 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:24 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-170ffd44-74bf-44d0-8c5c-4ff7796bc271" returned: 0 in 0.389s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:06:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b0cc93-410c-4552-a329-6617433a45f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-170ffd44-74bf-44d0-8c5c-4ff7796bc271', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8cb7879-2f9c-4b66-b36b-60e296dcca2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:24 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Volume volume-170ffd44-74bf-44d0-8c5c-4ff7796bc271 (170ffd44-74bf-44d0-8c5c-4ff7796bc271): created successfully Sep 25 17:06:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8cb7879-2f9c-4b66-b36b-60e296dcca2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Flow 'volume_create_manager' (590dd9ec-d3c5-4837-9214-f418a9288e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:06:24 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-adedc096-7d34-417c-9b83-08c405d1bdbf req-c3f02e53-7e97-4055-b0f5-9dc3cafa84f2 tempest-VolumesGetTestJSON-717104999 None] Created volume successfully. Sep 25 17:06:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-2b5d4b31-32f4-40f0-b3a7-9f2bca140566 req-c50d8c46-b6f1-4d50-aa95-95f30b40e234 tempest-VolumesGetTestJSON-717104999 None] Acquiring lock "cinder-170ffd44-74bf-44d0-8c5c-4ff7796bc271-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-2b5d4b31-32f4-40f0-b3a7-9f2bca140566 req-c50d8c46-b6f1-4d50-aa95-95f30b40e234 tempest-VolumesGetTestJSON-717104999 None] Lock "cinder-170ffd44-74bf-44d0-8c5c-4ff7796bc271-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-2b5d4b31-32f4-40f0-b3a7-9f2bca140566 req-c50d8c46-b6f1-4d50-aa95-95f30b40e234 tempest-VolumesGetTestJSON-717104999 None] Acquiring lock "cinder-quobyte-170ffd44-74bf-44d0-8c5c-4ff7796bc271" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-2b5d4b31-32f4-40f0-b3a7-9f2bca140566 req-c50d8c46-b6f1-4d50-aa95-95f30b40e234 tempest-VolumesGetTestJSON-717104999 None] Lock "cinder-quobyte-170ffd44-74bf-44d0-8c5c-4ff7796bc271" acquired by "delete_volume" :: waited 0.022s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[af370531-e6d0-4e2f-b8d2-e3d36fd945c3]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-2b5d4b31-32f4-40f0-b3a7-9f2bca140566 req-c50d8c46-b6f1-4d50-aa95-95f30b40e234 tempest-VolumesGetTestJSON-717104999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-170ffd44-74bf-44d0-8c5c-4ff7796bc271 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:26 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-170ffd44-74bf-44d0-8c5c-4ff7796bc271 Sep 25 17:06:26 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Flow 'volume_create_manager' (fd6d529a-e708-4a96-9de0-d0f0a969c693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d76d64b5-a5bb-4e1e-9e56-0d3c8fada84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d76d64b5-a5bb-4e1e-9e56-0d3c8fada84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-470644920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de77c133-9673-4d21-9798-e05e0a23cc30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88bfcb357b64d8e8cb4e77595c34481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:26Z,use_quota=True,user_id='8d50c92913ed4f10b019405592799f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143d2725-280c-450d-af59-e13c40a1f9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143d2725-280c-450d-af59-e13c40a1f9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daca3614-5a5e-4802-9b84-432d350865e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daca3614-5a5e-4802-9b84-432d350865e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de77c133-9673-4d21-9798-e05e0a23cc30', 'volume_name': 'volume-de77c133-9673-4d21-9798-e05e0a23cc30', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c2cd6a-27d0-4396-86d7-33f3b65b642f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c2cd6a-27d0-4396-86d7-33f3b65b642f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7159206a-0b7c-43b2-ae4d-1ae094f98440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:26 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Volume de77c133-9673-4d21-9798-e05e0a23cc30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de77c133-9673-4d21-9798-e05e0a23cc30', 'volume_size': 1} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-470644920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de77c133-9673-4d21-9798-e05e0a23cc30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88bfcb357b64d8e8cb4e77595c34481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:26Z,use_quota=True,user_id='8d50c92913ed4f10b019405592799f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Creating volume de77c133-9673-4d21-9798-e05e0a23cc30 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:06:26 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-de77c133-9673-4d21-9798-e05e0a23cc30 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:26 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-2b5d4b31-32f4-40f0-b3a7-9f2bca140566 req-c50d8c46-b6f1-4d50-aa95-95f30b40e234 tempest-VolumesGetTestJSON-717104999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-170ffd44-74bf-44d0-8c5c-4ff7796bc271" returned: 0 in 0.735s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-2b5d4b31-32f4-40f0-b3a7-9f2bca140566 req-c50d8c46-b6f1-4d50-aa95-95f30b40e234 tempest-VolumesGetTestJSON-717104999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-170ffd44-74bf-44d0-8c5c-4ff7796bc271 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:26 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-de77c133-9673-4d21-9798-e05e0a23cc30 1073741824 Sep 25 17:06:26 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:26 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-170ffd44-74bf-44d0-8c5c-4ff7796bc271 Sep 25 17:06:26 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:27 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-2b5d4b31-32f4-40f0-b3a7-9f2bca140566 req-c50d8c46-b6f1-4d50-aa95-95f30b40e234 tempest-VolumesGetTestJSON-717104999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-170ffd44-74bf-44d0-8c5c-4ff7796bc271" returned: 0 in 0.396s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-2b5d4b31-32f4-40f0-b3a7-9f2bca140566 req-c50d8c46-b6f1-4d50-aa95-95f30b40e234 tempest-VolumesGetTestJSON-717104999 None] Lock "cinder-quobyte-170ffd44-74bf-44d0-8c5c-4ff7796bc271" released by "delete_volume" :: held 1.224s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:27 devstack cinder-volume[87211]: DEBUG cinder.quota [req-2b5d4b31-32f4-40f0-b3a7-9f2bca140566 req-c50d8c46-b6f1-4d50-aa95-95f30b40e234 tempest-VolumesGetTestJSON-717104999 None] Created reservations ['12e41207-a537-4124-bacd-9187a36ef1f2', 'd9c6677d-2715-4005-badc-d34b7d23954c', '50e470ef-7460-4a86-b477-4267371261b5', '60da21c2-3c3e-4c9e-bf49-89c197af12b1'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:06:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-2b5d4b31-32f4-40f0-b3a7-9f2bca140566 req-c50d8c46-b6f1-4d50-aa95-95f30b40e234 tempest-VolumesGetTestJSON-717104999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-2b5d4b31-32f4-40f0-b3a7-9f2bca140566 req-c50d8c46-b6f1-4d50-aa95-95f30b40e234 tempest-VolumesGetTestJSON-717104999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [req-2b5d4b31-32f4-40f0-b3a7-9f2bca140566 req-c50d8c46-b6f1-4d50-aa95-95f30b40e234 tempest-VolumesGetTestJSON-717104999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:06:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [req-2b5d4b31-32f4-40f0-b3a7-9f2bca140566 req-c50d8c46-b6f1-4d50-aa95-95f30b40e234 tempest-VolumesGetTestJSON-717104999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:06:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-2b5d4b31-32f4-40f0-b3a7-9f2bca140566 req-c50d8c46-b6f1-4d50-aa95-95f30b40e234 tempest-VolumesGetTestJSON-717104999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-2b5d4b31-32f4-40f0-b3a7-9f2bca140566 req-c50d8c46-b6f1-4d50-aa95-95f30b40e234 tempest-VolumesGetTestJSON-717104999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:27 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:06:27 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:27 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-de77c133-9673-4d21-9798-e05e0a23cc30 1073741824" returned: 0 in 0.661s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-de77c133-9673-4d21-9798-e05e0a23cc30 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:27 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-de77c133-9673-4d21-9798-e05e0a23cc30 Sep 25 17:06:27 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:27 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-2b5d4b31-32f4-40f0-b3a7-9f2bca140566 req-c50d8c46-b6f1-4d50-aa95-95f30b40e234 tempest-VolumesGetTestJSON-717104999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.388s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:27 devstack cinder-volume[87211]: DEBUG cinder.manager [req-2b5d4b31-32f4-40f0-b3a7-9f2bca140566 req-c50d8c46-b6f1-4d50-aa95-95f30b40e234 tempest-VolumesGetTestJSON-717104999 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:06:27 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-2b5d4b31-32f4-40f0-b3a7-9f2bca140566 req-c50d8c46-b6f1-4d50-aa95-95f30b40e234 tempest-VolumesGetTestJSON-717104999 None] Deleted volume successfully. Sep 25 17:06:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-2b5d4b31-32f4-40f0-b3a7-9f2bca140566 req-c50d8c46-b6f1-4d50-aa95-95f30b40e234 tempest-VolumesGetTestJSON-717104999 None] Lock "cinder-170ffd44-74bf-44d0-8c5c-4ff7796bc271-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:27 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-de77c133-9673-4d21-9798-e05e0a23cc30" returned: 0 in 0.384s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:06:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7159206a-0b7c-43b2-ae4d-1ae094f98440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de77c133-9673-4d21-9798-e05e0a23cc30', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e77ae5-bb4f-43c8-b819-4485adb00c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:27 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Volume volume-de77c133-9673-4d21-9798-e05e0a23cc30 (de77c133-9673-4d21-9798-e05e0a23cc30): created successfully Sep 25 17:06:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e77ae5-bb4f-43c8-b819-4485adb00c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Flow 'volume_create_manager' (fd6d529a-e708-4a96-9de0-d0f0a969c693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:06:27 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-649004ce-0ace-43fb-a2d0-d92ea2ddfd26 tempest-VolumesActionsTest-1296066307 None] Created volume successfully. Sep 25 17:06:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b143fe0d-dff7-4343-aee9-b0349e7db92f tempest-VolumesActionsTest-337222283 None] Acquiring lock "cinder-de77c133-9673-4d21-9798-e05e0a23cc30-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b143fe0d-dff7-4343-aee9-b0349e7db92f tempest-VolumesActionsTest-337222283 None] Lock "cinder-de77c133-9673-4d21-9798-e05e0a23cc30-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b143fe0d-dff7-4343-aee9-b0349e7db92f tempest-VolumesActionsTest-337222283 None] Acquiring lock "cinder-quobyte-de77c133-9673-4d21-9798-e05e0a23cc30" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b143fe0d-dff7-4343-aee9-b0349e7db92f tempest-VolumesActionsTest-337222283 None] Lock "cinder-quobyte-de77c133-9673-4d21-9798-e05e0a23cc30" acquired by "delete_volume" :: waited 0.016s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:28 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[851d0776-8e90-4b31-9798-00a1d281268d]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:06:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b143fe0d-dff7-4343-aee9-b0349e7db92f tempest-VolumesActionsTest-337222283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-de77c133-9673-4d21-9798-e05e0a23cc30 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:29 devstack sudo[89971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-de77c133-9673-4d21-9798-e05e0a23cc30 Sep 25 17:06:29 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:29 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b143fe0d-dff7-4343-aee9-b0349e7db92f tempest-VolumesActionsTest-337222283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-de77c133-9673-4d21-9798-e05e0a23cc30" returned: 0 in 0.397s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b143fe0d-dff7-4343-aee9-b0349e7db92f tempest-VolumesActionsTest-337222283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-de77c133-9673-4d21-9798-e05e0a23cc30 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:29 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-de77c133-9673-4d21-9798-e05e0a23cc30 Sep 25 17:06:29 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:29 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b143fe0d-dff7-4343-aee9-b0349e7db92f tempest-VolumesActionsTest-337222283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-de77c133-9673-4d21-9798-e05e0a23cc30" returned: 0 in 0.320s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b143fe0d-dff7-4343-aee9-b0349e7db92f tempest-VolumesActionsTest-337222283 None] Lock "cinder-quobyte-de77c133-9673-4d21-9798-e05e0a23cc30" released by "delete_volume" :: held 0.775s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:29 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-b143fe0d-dff7-4343-aee9-b0349e7db92f tempest-VolumesActionsTest-337222283 None] Created reservations ['ba1e8392-5532-4164-9b1f-f122fcd42063', '3e59e4d9-1455-473b-b226-6ac1a40a4113', '68a45116-310f-4d63-a1bd-30bf639bb5bb', '106f9e64-6093-44a6-af8b-df69ca4b3e63'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:06:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b143fe0d-dff7-4343-aee9-b0349e7db92f tempest-VolumesActionsTest-337222283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b143fe0d-dff7-4343-aee9-b0349e7db92f tempest-VolumesActionsTest-337222283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:29 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b143fe0d-dff7-4343-aee9-b0349e7db92f tempest-VolumesActionsTest-337222283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:06:29 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b143fe0d-dff7-4343-aee9-b0349e7db92f tempest-VolumesActionsTest-337222283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:06:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b143fe0d-dff7-4343-aee9-b0349e7db92f tempest-VolumesActionsTest-337222283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b143fe0d-dff7-4343-aee9-b0349e7db92f tempest-VolumesActionsTest-337222283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:29 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:06:29 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:30 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b143fe0d-dff7-4343-aee9-b0349e7db92f tempest-VolumesActionsTest-337222283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.349s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-b143fe0d-dff7-4343-aee9-b0349e7db92f tempest-VolumesActionsTest-337222283 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:06:30 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b143fe0d-dff7-4343-aee9-b0349e7db92f tempest-VolumesActionsTest-337222283 None] Deleted volume successfully. Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b143fe0d-dff7-4343-aee9-b0349e7db92f tempest-VolumesActionsTest-337222283 None] Lock "cinder-de77c133-9673-4d21-9798-e05e0a23cc30-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Flow 'volume_create_manager' (462c703f-59e2-4972-8da5-e3ce366917b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0172d170-91a9-4360-bdf4-4c920f85a3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0172d170-91a9-4360-bdf4-4c920f85a3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1410144740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d98111-258d-4a81-a590-ce68f43d25d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88bfcb357b64d8e8cb4e77595c34481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:31Z,use_quota=True,user_id='8d50c92913ed4f10b019405592799f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (032d990f-3919-47df-9412-a86e723aeb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (032d990f-3919-47df-9412-a86e723aeb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da06897b-9582-465b-b369-b30d6ffb5589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da06897b-9582-465b-b369-b30d6ffb5589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2d98111-258d-4a81-a590-ce68f43d25d0', 'volume_name': 'volume-a2d98111-258d-4a81-a590-ce68f43d25d0', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc4922e-b732-4fa4-851f-668c7e73fdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc4922e-b732-4fa4-851f-668c7e73fdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8322801f-0016-4b94-9aa1-e4118efdb1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:30 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Volume a2d98111-258d-4a81-a590-ce68f43d25d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2d98111-258d-4a81-a590-ce68f43d25d0', 'volume_size': 1} Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1410144740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d98111-258d-4a81-a590-ce68f43d25d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88bfcb357b64d8e8cb4e77595c34481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:31Z,use_quota=True,user_id='8d50c92913ed4f10b019405592799f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Creating volume a2d98111-258d-4a81-a590-ce68f43d25d0 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:06:30 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:06:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a2d98111-258d-4a81-a590-ce68f43d25d0 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:30 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a2d98111-258d-4a81-a590-ce68f43d25d0 1073741824 Sep 25 17:06:30 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:31 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a2d98111-258d-4a81-a590-ce68f43d25d0 1073741824" returned: 0 in 0.490s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a2d98111-258d-4a81-a590-ce68f43d25d0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:31 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a2d98111-258d-4a81-a590-ce68f43d25d0 Sep 25 17:06:31 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:31 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a2d98111-258d-4a81-a590-ce68f43d25d0" returned: 0 in 0.370s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:31 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:06:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8322801f-0016-4b94-9aa1-e4118efdb1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2d98111-258d-4a81-a590-ce68f43d25d0', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e2d9a4-23a0-4d73-8785-99f6dfb50520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:31 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Volume volume-a2d98111-258d-4a81-a590-ce68f43d25d0 (a2d98111-258d-4a81-a590-ce68f43d25d0): created successfully Sep 25 17:06:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e2d9a4-23a0-4d73-8785-99f6dfb50520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Flow 'volume_create_manager' (462c703f-59e2-4972-8da5-e3ce366917b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:06:31 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-815cfd8c-b6fc-48df-919e-cc4063138d35 tempest-VolumesActionsTest-1296066307 None] Created volume successfully. Sep 25 17:06:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-91a873dd-169e-4c9e-a841-b98dfcd13cb6 tempest-VolumesActionsTest-337222283 None] Acquiring lock "cinder-a2d98111-258d-4a81-a590-ce68f43d25d0-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-91a873dd-169e-4c9e-a841-b98dfcd13cb6 tempest-VolumesActionsTest-337222283 None] Lock "cinder-a2d98111-258d-4a81-a590-ce68f43d25d0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-91a873dd-169e-4c9e-a841-b98dfcd13cb6 tempest-VolumesActionsTest-337222283 None] Acquiring lock "cinder-quobyte-a2d98111-258d-4a81-a590-ce68f43d25d0" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-91a873dd-169e-4c9e-a841-b98dfcd13cb6 tempest-VolumesActionsTest-337222283 None] Lock "cinder-quobyte-a2d98111-258d-4a81-a590-ce68f43d25d0" acquired by "delete_volume" :: waited 0.017s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:33 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f466bd9-7079-462f-a5d1-eea8ca241341]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:06:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-91a873dd-169e-4c9e-a841-b98dfcd13cb6 tempest-VolumesActionsTest-337222283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a2d98111-258d-4a81-a590-ce68f43d25d0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:33 devstack sudo[89991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a2d98111-258d-4a81-a590-ce68f43d25d0 Sep 25 17:06:33 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:33 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-91a873dd-169e-4c9e-a841-b98dfcd13cb6 tempest-VolumesActionsTest-337222283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a2d98111-258d-4a81-a590-ce68f43d25d0" returned: 0 in 0.524s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-91a873dd-169e-4c9e-a841-b98dfcd13cb6 tempest-VolumesActionsTest-337222283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a2d98111-258d-4a81-a590-ce68f43d25d0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:33 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a2d98111-258d-4a81-a590-ce68f43d25d0 Sep 25 17:06:33 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:34 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-91a873dd-169e-4c9e-a841-b98dfcd13cb6 tempest-VolumesActionsTest-337222283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a2d98111-258d-4a81-a590-ce68f43d25d0" returned: 0 in 0.334s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-91a873dd-169e-4c9e-a841-b98dfcd13cb6 tempest-VolumesActionsTest-337222283 None] Lock "cinder-quobyte-a2d98111-258d-4a81-a590-ce68f43d25d0" released by "delete_volume" :: held 0.947s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:34 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-91a873dd-169e-4c9e-a841-b98dfcd13cb6 tempest-VolumesActionsTest-337222283 None] Created reservations ['8c31ef0f-2537-4454-9f5b-81ea96884bb4', 'c35a95cd-c894-4772-94eb-9b97074deea6', '1e50bbbe-8b7c-4c04-8b61-16c72cbac022', '45ce5987-8b2f-457d-a664-0cef4ff38c11'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:06:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-91a873dd-169e-4c9e-a841-b98dfcd13cb6 tempest-VolumesActionsTest-337222283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-91a873dd-169e-4c9e-a841-b98dfcd13cb6 tempest-VolumesActionsTest-337222283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-91a873dd-169e-4c9e-a841-b98dfcd13cb6 tempest-VolumesActionsTest-337222283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:06:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-91a873dd-169e-4c9e-a841-b98dfcd13cb6 tempest-VolumesActionsTest-337222283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:06:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-91a873dd-169e-4c9e-a841-b98dfcd13cb6 tempest-VolumesActionsTest-337222283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-91a873dd-169e-4c9e-a841-b98dfcd13cb6 tempest-VolumesActionsTest-337222283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:34 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:06:34 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:34 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-91a873dd-169e-4c9e-a841-b98dfcd13cb6 tempest-VolumesActionsTest-337222283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.393s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:34 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-91a873dd-169e-4c9e-a841-b98dfcd13cb6 tempest-VolumesActionsTest-337222283 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:06:34 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-91a873dd-169e-4c9e-a841-b98dfcd13cb6 tempest-VolumesActionsTest-337222283 None] Deleted volume successfully. Sep 25 17:06:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-91a873dd-169e-4c9e-a841-b98dfcd13cb6 tempest-VolumesActionsTest-337222283 None] Lock "cinder-a2d98111-258d-4a81-a590-ce68f43d25d0-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Flow 'volume_create_manager' (f7b2c8a2-bf7a-4563-afba-5c552cc17d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d060a986-2b0d-4ee7-ae81-b9948de1ae7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d060a986-2b0d-4ee7-ae81-b9948de1ae7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1416109548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1263412a-1590-4ee6-bb83-5e575af0abac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88bfcb357b64d8e8cb4e77595c34481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:36Z,use_quota=True,user_id='8d50c92913ed4f10b019405592799f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44e6872-a56d-4566-a592-7d8e7e44f5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44e6872-a56d-4566-a592-7d8e7e44f5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e9a50c-a57d-47e7-9e59-0a40f541df6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e9a50c-a57d-47e7-9e59-0a40f541df6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1263412a-1590-4ee6-bb83-5e575af0abac', 'volume_name': 'volume-1263412a-1590-4ee6-bb83-5e575af0abac', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a11e1bcd-54bd-4dcb-81f7-d8d98044e23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a11e1bcd-54bd-4dcb-81f7-d8d98044e23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99746257-e020-41ae-bd57-75519fc10e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:36 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Volume 1263412a-1590-4ee6-bb83-5e575af0abac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1263412a-1590-4ee6-bb83-5e575af0abac', 'volume_size': 1} Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1416109548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1263412a-1590-4ee6-bb83-5e575af0abac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88bfcb357b64d8e8cb4e77595c34481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:36Z,use_quota=True,user_id='8d50c92913ed4f10b019405592799f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Creating volume 1263412a-1590-4ee6-bb83-5e575af0abac {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:06:36 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1263412a-1590-4ee6-bb83-5e575af0abac 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:36 devstack sudo[90034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1263412a-1590-4ee6-bb83-5e575af0abac 1073741824 Sep 25 17:06:36 devstack sudo[90034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:36 devstack sudo[90034]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1263412a-1590-4ee6-bb83-5e575af0abac 1073741824" returned: 0 in 0.554s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1263412a-1590-4ee6-bb83-5e575af0abac {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:36 devstack sudo[90049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1263412a-1590-4ee6-bb83-5e575af0abac Sep 25 17:06:36 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-b5d3e659-66b2-49cf-867a-e786dd9a569f req-2d97b82b-42bf-4c23-ad3a-ade4aa677c54 tempest-ServerActionsTestOtherA-902126569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:37 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1263412a-1590-4ee6-bb83-5e575af0abac" returned: 0 in 0.265s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:06:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-b5d3e659-66b2-49cf-867a-e786dd9a569f req-2d97b82b-42bf-4c23-ad3a-ade4aa677c54 tempest-ServerActionsTestOtherA-902126569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.160s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99746257-e020-41ae-bd57-75519fc10e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1263412a-1590-4ee6-bb83-5e575af0abac', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1647bd-0f9e-454d-8e52-80ed5f9bb30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-b5d3e659-66b2-49cf-867a-e786dd9a569f req-2d97b82b-42bf-4c23-ad3a-ade4aa677c54 tempest-ServerActionsTestOtherA-902126569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:37 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Volume volume-1263412a-1590-4ee6-bb83-5e575af0abac (1263412a-1590-4ee6-bb83-5e575af0abac): created successfully Sep 25 17:06:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1647bd-0f9e-454d-8e52-80ed5f9bb30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Flow 'volume_create_manager' (f7b2c8a2-bf7a-4563-afba-5c552cc17d27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:06:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-b5d3e659-66b2-49cf-867a-e786dd9a569f req-2d97b82b-42bf-4c23-ad3a-ade4aa677c54 tempest-ServerActionsTestOtherA-902126569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-fe3d1f17-0ca2-4009-971b-bd622a5e0354', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84410d16-e2d9-4e60-a11e-ec01d81baada', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:06:37 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-63b31362-cd7c-48eb-a24c-9d380ec0e6e4 tempest-VolumesActionsTest-1296066307 None] Created volume successfully. Sep 25 17:06:37 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-b5d3e659-66b2-49cf-867a-e786dd9a569f req-2d97b82b-42bf-4c23-ad3a-ade4aa677c54 tempest-ServerActionsTestOtherA-902126569 None] attachment_update completed successfully. Sep 25 17:06:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e70653f7-fa35-43c4-9962-e516ea2f9d35 tempest-VolumesActionsTest-337222283 None] Acquiring lock "cinder-1263412a-1590-4ee6-bb83-5e575af0abac-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e70653f7-fa35-43c4-9962-e516ea2f9d35 tempest-VolumesActionsTest-337222283 None] Lock "cinder-1263412a-1590-4ee6-bb83-5e575af0abac-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:38 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-3d393546-1d00-4138-bb48-2b95e5dc87b3 tempest-GroupSnapshotsTest-1623939309 None] Group tempest-GroupSnapshotsTest-Group-423405125: creating Sep 25 17:06:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e70653f7-fa35-43c4-9962-e516ea2f9d35 tempest-VolumesActionsTest-337222283 None] Acquiring lock "cinder-quobyte-1263412a-1590-4ee6-bb83-5e575af0abac" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:38 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-3d393546-1d00-4138-bb48-2b95e5dc87b3 tempest-GroupSnapshotsTest-1623939309 None] Group tempest-GroupSnapshotsTest-Group-423405125: created successfully Sep 25 17:06:38 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-3d393546-1d00-4138-bb48-2b95e5dc87b3 tempest-GroupSnapshotsTest-1623939309 None] Create group completed successfully. Sep 25 17:06:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e70653f7-fa35-43c4-9962-e516ea2f9d35 tempest-VolumesActionsTest-337222283 None] Lock "cinder-quobyte-1263412a-1590-4ee6-bb83-5e575af0abac" acquired by "delete_volume" :: waited 0.017s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:38 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faaa1e5-2c14-4b3f-b942-016e8979da0e]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:06:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e70653f7-fa35-43c4-9962-e516ea2f9d35 tempest-VolumesActionsTest-337222283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1263412a-1590-4ee6-bb83-5e575af0abac {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:38 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1263412a-1590-4ee6-bb83-5e575af0abac Sep 25 17:06:38 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:38 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e70653f7-fa35-43c4-9962-e516ea2f9d35 tempest-VolumesActionsTest-337222283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1263412a-1590-4ee6-bb83-5e575af0abac" returned: 0 in 0.391s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e70653f7-fa35-43c4-9962-e516ea2f9d35 tempest-VolumesActionsTest-337222283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1263412a-1590-4ee6-bb83-5e575af0abac {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:38 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1263412a-1590-4ee6-bb83-5e575af0abac Sep 25 17:06:38 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:39 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e70653f7-fa35-43c4-9962-e516ea2f9d35 tempest-VolumesActionsTest-337222283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1263412a-1590-4ee6-bb83-5e575af0abac" returned: 0 in 0.246s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e70653f7-fa35-43c4-9962-e516ea2f9d35 tempest-VolumesActionsTest-337222283 None] Lock "cinder-quobyte-1263412a-1590-4ee6-bb83-5e575af0abac" released by "delete_volume" :: held 0.681s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:39 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-e70653f7-fa35-43c4-9962-e516ea2f9d35 tempest-VolumesActionsTest-337222283 None] Created reservations ['14fc4b27-59f8-414a-ade6-deae6747852c', 'fa831ab6-5b29-4d10-8e81-005de35455b4', '80a9ce0e-1d35-463a-a322-eaca64bc9a9c', '1804a475-b744-4608-8226-be45ae25d3a9'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:06:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e70653f7-fa35-43c4-9962-e516ea2f9d35 tempest-VolumesActionsTest-337222283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e70653f7-fa35-43c4-9962-e516ea2f9d35 tempest-VolumesActionsTest-337222283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e70653f7-fa35-43c4-9962-e516ea2f9d35 tempest-VolumesActionsTest-337222283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:06:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e70653f7-fa35-43c4-9962-e516ea2f9d35 tempest-VolumesActionsTest-337222283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:06:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e70653f7-fa35-43c4-9962-e516ea2f9d35 tempest-VolumesActionsTest-337222283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e70653f7-fa35-43c4-9962-e516ea2f9d35 tempest-VolumesActionsTest-337222283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:39 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:06:39 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:39 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e70653f7-fa35-43c4-9962-e516ea2f9d35 tempest-VolumesActionsTest-337222283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.259s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:39 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-e70653f7-fa35-43c4-9962-e516ea2f9d35 tempest-VolumesActionsTest-337222283 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:06:39 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-e70653f7-fa35-43c4-9962-e516ea2f9d35 tempest-VolumesActionsTest-337222283 None] Deleted volume successfully. Sep 25 17:06:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e70653f7-fa35-43c4-9962-e516ea2f9d35 tempest-VolumesActionsTest-337222283 None] Lock "cinder-1263412a-1590-4ee6-bb83-5e575af0abac-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Flow 'volume_create_manager' (7d7f8389-49cc-477e-aa1c-c32dfc3b6972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05087431-00b9-4df2-bc6d-0887524836c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05087431-00b9-4df2-bc6d-0887524836c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1365205905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d56abaf-ea4e-4287-9cc8-743f5730fafc,host='devstack@QuobyteHD#QuobyteHD',id=002bf1b6-0312-4240-bc22-549260e24159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b588af0f4f46446da58a50cbd4f6a420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:40Z,use_quota=True,user_id='11edca724f1e44369423a6b59b027cbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0587fb0e-3b2b-4d45-a14e-666cc43fecfd),volume_type_id=0587fb0e-3b2b-4d45-a14e-666cc43fecfd)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3e8822-151a-4e62-b16d-ac575a5f5647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3e8822-151a-4e62-b16d-ac575a5f5647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fac0429-f70d-4e07-8374-288be80569fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fac0429-f70d-4e07-8374-288be80569fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '002bf1b6-0312-4240-bc22-549260e24159', 'volume_name': 'volume-002bf1b6-0312-4240-bc22-549260e24159', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878c4ef2-7912-4a4c-802a-1bb93f3f7d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878c4ef2-7912-4a4c-802a-1bb93f3f7d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ea3139-a8b2-45e8-bc41-5ed9c1f8766e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:40 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Volume 002bf1b6-0312-4240-bc22-549260e24159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-002bf1b6-0312-4240-bc22-549260e24159', 'volume_size': 1} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6d56abaf-ea4e-4287-9cc8-743f5730fafc,created_at=2026-09-25T15:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1365205905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d56abaf-ea4e-4287-9cc8-743f5730fafc,host='devstack@QuobyteHD#QuobyteHD',id=002bf1b6-0312-4240-bc22-549260e24159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b588af0f4f46446da58a50cbd4f6a420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:40Z,use_quota=True,user_id='11edca724f1e44369423a6b59b027cbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0587fb0e-3b2b-4d45-a14e-666cc43fecfd),volume_type_id=0587fb0e-3b2b-4d45-a14e-666cc43fecfd)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Creating volume 002bf1b6-0312-4240-bc22-549260e24159 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:06:40 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:40 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159 1073741824 Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:06:40 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Flow 'volume_create_manager' (5fba0f01-1098-4991-b742-9c604818c552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a71e40-8b52-4265-9747-01db67c7820c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a71e40-8b52-4265-9747-01db67c7820c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1701434682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b77b59-8aa8-4af4-b819-aac2e8154f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88bfcb357b64d8e8cb4e77595c34481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:40Z,use_quota=True,user_id='8d50c92913ed4f10b019405592799f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e8a152-379c-457e-b2cc-036209f851a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e8a152-379c-457e-b2cc-036209f851a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f7ad9a9-3c3f-4a72-975b-ac00001b7666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f7ad9a9-3c3f-4a72-975b-ac00001b7666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42b77b59-8aa8-4af4-b819-aac2e8154f8b', 'volume_name': 'volume-42b77b59-8aa8-4af4-b819-aac2e8154f8b', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faadc046-de05-47db-9734-194dce8b0313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faadc046-de05-47db-9734-194dce8b0313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbaae067-d142-47ff-8b86-851d2423d8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:40 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Volume 42b77b59-8aa8-4af4-b819-aac2e8154f8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42b77b59-8aa8-4af4-b819-aac2e8154f8b', 'volume_size': 1} Sep 25 17:06:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:41 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-458a919d-22c1-40d0-b7c1-65d783e9289b req-5e2ea402-3d7b-4143-8e1e-3473beae35d1 tempest-ServerActionsTestOtherA-902126569 None] Terminate volume connection completed successfully. Sep 25 17:06:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-458a919d-22c1-40d0-b7c1-65d783e9289b req-5e2ea402-3d7b-4143-8e1e-3473beae35d1 tempest-ServerActionsTestOtherA-902126569 None] Deleting attachment 84410d16-e2d9-4e60-a11e-ec01d81baada. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:06:41 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159 1073741824" returned: 0 in 0.609s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:41 devstack sudo[90529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159 Sep 25 17:06:41 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:41 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159" returned: 0 in 0.601s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:06:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.139s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1701434682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b77b59-8aa8-4af4-b819-aac2e8154f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88bfcb357b64d8e8cb4e77595c34481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:40Z,use_quota=True,user_id='8d50c92913ed4f10b019405592799f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:06:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Creating volume 42b77b59-8aa8-4af4-b819-aac2e8154f8b {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:06:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:06:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:06:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:06:41 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:06:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42b77b59-8aa8-4af4-b819-aac2e8154f8b 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ea3139-a8b2-45e8-bc41-5ed9c1f8766e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-002bf1b6-0312-4240-bc22-549260e24159', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:41 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42b77b59-8aa8-4af4-b819-aac2e8154f8b 1073741824 Sep 25 17:06:41 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565b027b-acab-4b0b-8f3d-f9b2bada06d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:41 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Volume volume-002bf1b6-0312-4240-bc22-549260e24159 (002bf1b6-0312-4240-bc22-549260e24159): created successfully Sep 25 17:06:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565b027b-acab-4b0b-8f3d-f9b2bada06d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Flow 'volume_create_manager' (7d7f8389-49cc-477e-aa1c-c32dfc3b6972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:06:41 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-169f0b95-0fac-401e-9187-622f2f21bfdd tempest-GroupSnapshotsTest-1623939309 None] Created volume successfully. Sep 25 17:06:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-458a919d-22c1-40d0-b7c1-65d783e9289b req-92cbf1fc-4d8f-4c28-bf11-1f2d95773b76 tempest-ServerActionsTestOtherA-902126569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:42 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42b77b59-8aa8-4af4-b819-aac2e8154f8b 1073741824" returned: 0 in 0.575s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42b77b59-8aa8-4af4-b819-aac2e8154f8b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:42 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42b77b59-8aa8-4af4-b819-aac2e8154f8b Sep 25 17:06:42 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:42 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42b77b59-8aa8-4af4-b819-aac2e8154f8b" returned: 0 in 0.239s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:06:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-458a919d-22c1-40d0-b7c1-65d783e9289b req-92cbf1fc-4d8f-4c28-bf11-1f2d95773b76 tempest-ServerActionsTestOtherA-902126569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.498s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-458a919d-22c1-40d0-b7c1-65d783e9289b req-92cbf1fc-4d8f-4c28-bf11-1f2d95773b76 tempest-ServerActionsTestOtherA-902126569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbaae067-d142-47ff-8b86-851d2423d8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42b77b59-8aa8-4af4-b819-aac2e8154f8b', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feff7e9f-a0ed-440e-856d-62262d0f2b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:42 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Volume volume-42b77b59-8aa8-4af4-b819-aac2e8154f8b (42b77b59-8aa8-4af4-b819-aac2e8154f8b): created successfully Sep 25 17:06:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feff7e9f-a0ed-440e-856d-62262d0f2b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Flow 'volume_create_manager' (5fba0f01-1098-4991-b742-9c604818c552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:06:42 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-1edd0cbf-1272-4b59-b5ef-e72d1ba88f07 tempest-VolumesActionsTest-1296066307 None] Created volume successfully. Sep 25 17:06:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-458a919d-22c1-40d0-b7c1-65d783e9289b req-92cbf1fc-4d8f-4c28-bf11-1f2d95773b76 tempest-ServerActionsTestOtherA-902126569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-fe3d1f17-0ca2-4009-971b-bd622a5e0354', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '143c07ab-6736-4ff9-8f45-86c17e1542db', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:06:42 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-458a919d-22c1-40d0-b7c1-65d783e9289b req-92cbf1fc-4d8f-4c28-bf11-1f2d95773b76 tempest-ServerActionsTestOtherA-902126569 None] attachment_update completed successfully. Sep 25 17:06:43 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-226ae710-dafd-45f1-adaa-2dd2ae343907 tempest-GroupSnapshotsTest-1623939309 None] GroupSnapshot 121fadb3-7c2c-4356-bbc4-ecbec12c513c: creating. Sep 25 17:06:43 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-226ae710-dafd-45f1-adaa-2dd2ae343907 tempest-GroupSnapshotsTest-1623939309 None] Group snapshot 121fadb3-7c2c-4356-bbc4-ecbec12c513c: creating. {{(pid=87211) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 17:06:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-226ae710-dafd-45f1-adaa-2dd2ae343907 tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-226ae710-dafd-45f1-adaa-2dd2ae343907 tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-226ae710-dafd-45f1-adaa-2dd2ae343907 tempest-GroupSnapshotsTest-1623939309 None] Creating offline snapshot 9043c5d4-2078-496d-8bc5-c4686b14d3da of volume 002bf1b6-0312-4240-bc22-549260e24159 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:06:43 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[946f1d1c-8e38-437d-8d44-d32d6d434602]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:06:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-226ae710-dafd-45f1-adaa-2dd2ae343907 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:43 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159 Sep 25 17:06:43 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1a37b386-9c26-4dd8-9ff6-900a3a79ada6 tempest-VolumesActionsTest-337222283 None] Acquiring lock "cinder-42b77b59-8aa8-4af4-b819-aac2e8154f8b-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1a37b386-9c26-4dd8-9ff6-900a3a79ada6 tempest-VolumesActionsTest-337222283 None] Lock "cinder-42b77b59-8aa8-4af4-b819-aac2e8154f8b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1a37b386-9c26-4dd8-9ff6-900a3a79ada6 tempest-VolumesActionsTest-337222283 None] Acquiring lock "cinder-quobyte-42b77b59-8aa8-4af4-b819-aac2e8154f8b" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1a37b386-9c26-4dd8-9ff6-900a3a79ada6 tempest-VolumesActionsTest-337222283 None] Lock "cinder-quobyte-42b77b59-8aa8-4af4-b819-aac2e8154f8b" acquired by "delete_volume" :: waited 0.024s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:43 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3e9f8e-89f6-415a-bad9-531b2f37fa7a]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:06:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1a37b386-9c26-4dd8-9ff6-900a3a79ada6 tempest-VolumesActionsTest-337222283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42b77b59-8aa8-4af4-b819-aac2e8154f8b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:43 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-226ae710-dafd-45f1-adaa-2dd2ae343907 tempest-GroupSnapshotsTest-1623939309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159" returned: 0 in 0.472s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-226ae710-dafd-45f1-adaa-2dd2ae343907 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:43 devstack sudo[90594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da 1G Sep 25 17:06:43 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:44 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42b77b59-8aa8-4af4-b819-aac2e8154f8b Sep 25 17:06:44 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:44 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1a37b386-9c26-4dd8-9ff6-900a3a79ada6 tempest-VolumesActionsTest-337222283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42b77b59-8aa8-4af4-b819-aac2e8154f8b" returned: 0 in 0.641s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1a37b386-9c26-4dd8-9ff6-900a3a79ada6 tempest-VolumesActionsTest-337222283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42b77b59-8aa8-4af4-b819-aac2e8154f8b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:44 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42b77b59-8aa8-4af4-b819-aac2e8154f8b Sep 25 17:06:44 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:44 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-226ae710-dafd-45f1-adaa-2dd2ae343907 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da 1G" returned: 0 in 0.766s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-226ae710-dafd-45f1-adaa-2dd2ae343907 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-002bf1b6-0312-4240-bc22-549260e24159 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:44 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-002bf1b6-0312-4240-bc22-549260e24159 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da Sep 25 17:06:44 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:44 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1a37b386-9c26-4dd8-9ff6-900a3a79ada6 tempest-VolumesActionsTest-337222283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42b77b59-8aa8-4af4-b819-aac2e8154f8b" returned: 0 in 0.378s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:44 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1a37b386-9c26-4dd8-9ff6-900a3a79ada6 tempest-VolumesActionsTest-337222283 None] Lock "cinder-quobyte-42b77b59-8aa8-4af4-b819-aac2e8154f8b" released by "delete_volume" :: held 1.094s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:45 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-1a37b386-9c26-4dd8-9ff6-900a3a79ada6 tempest-VolumesActionsTest-337222283 None] Created reservations ['7f34a77e-3410-4fa9-8646-03d4037c80c6', '4d5a4d0d-3061-4325-9362-ee08ee2ff9fa', 'afcbc6db-9257-4210-8619-aa91500a4a06', '93e4dbc3-0d37-4e38-8485-2c6cc3b7d35a'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:06:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1a37b386-9c26-4dd8-9ff6-900a3a79ada6 tempest-VolumesActionsTest-337222283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1a37b386-9c26-4dd8-9ff6-900a3a79ada6 tempest-VolumesActionsTest-337222283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1a37b386-9c26-4dd8-9ff6-900a3a79ada6 tempest-VolumesActionsTest-337222283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:06:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1a37b386-9c26-4dd8-9ff6-900a3a79ada6 tempest-VolumesActionsTest-337222283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:06:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1a37b386-9c26-4dd8-9ff6-900a3a79ada6 tempest-VolumesActionsTest-337222283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1a37b386-9c26-4dd8-9ff6-900a3a79ada6 tempest-VolumesActionsTest-337222283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:45 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:06:45 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:45 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-226ae710-dafd-45f1-adaa-2dd2ae343907 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-002bf1b6-0312-4240-bc22-549260e24159 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da" returned: 0 in 0.461s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:45 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-226ae710-dafd-45f1-adaa-2dd2ae343907 tempest-GroupSnapshotsTest-1623939309 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:06:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-226ae710-dafd-45f1-adaa-2dd2ae343907 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:45 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da Sep 25 17:06:45 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:45 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1a37b386-9c26-4dd8-9ff6-900a3a79ada6 tempest-VolumesActionsTest-337222283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.297s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:45 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-1a37b386-9c26-4dd8-9ff6-900a3a79ada6 tempest-VolumesActionsTest-337222283 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:06:45 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-1a37b386-9c26-4dd8-9ff6-900a3a79ada6 tempest-VolumesActionsTest-337222283 None] Deleted volume successfully. Sep 25 17:06:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1a37b386-9c26-4dd8-9ff6-900a3a79ada6 tempest-VolumesActionsTest-337222283 None] Lock "cinder-42b77b59-8aa8-4af4-b819-aac2e8154f8b-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:45 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-226ae710-dafd-45f1-adaa-2dd2ae343907 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da" returned: 0 in 0.340s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-226ae710-dafd-45f1-adaa-2dd2ae343907 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:45 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.info Sep 25 17:06:45 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:45 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-226ae710-dafd-45f1-adaa-2dd2ae343907 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.info" returned: 0 in 0.264s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:45 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-226ae710-dafd-45f1-adaa-2dd2ae343907 tempest-GroupSnapshotsTest-1623939309 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:06:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-226ae710-dafd-45f1-adaa-2dd2ae343907 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:45 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.info Sep 25 17:06:45 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:46 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-226ae710-dafd-45f1-adaa-2dd2ae343907 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.info" returned: 0 in 0.289s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-226ae710-dafd-45f1-adaa-2dd2ae343907 tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.728s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:46 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-226ae710-dafd-45f1-adaa-2dd2ae343907 tempest-GroupSnapshotsTest-1623939309 None] group_snapshot 121fadb3-7c2c-4356-bbc4-ecbec12c513c: created successfully Sep 25 17:06:46 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:06:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Flow 'volume_create_manager' (ece547c2-7de1-4b29-b0b5-032bcb711d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:06:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4f2c39-6615-4bad-badd-8a725be04ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4f2c39-6615-4bad-badd-8a725be04ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-812017987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88bfcb357b64d8e8cb4e77595c34481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:47Z,use_quota=True,user_id='8d50c92913ed4f10b019405592799f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5403e2a-c07b-4c55-bfc8-1de2702dc6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5403e2a-c07b-4c55-bfc8-1de2702dc6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906f5f9e-aa46-4715-8643-07cc2048c520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906f5f9e-aa46-4715-8643-07cc2048c520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba', 'volume_name': 'volume-f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9601f552-2257-4f3a-af43-05163321a0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9601f552-2257-4f3a-af43-05163321a0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f12f5a-b8cc-4f99-bc5f-7524fad513e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:47 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Volume f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba', 'volume_size': 1} Sep 25 17:06:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-812017987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88bfcb357b64d8e8cb4e77595c34481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:47Z,use_quota=True,user_id='8d50c92913ed4f10b019405592799f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:06:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Creating volume f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:06:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:06:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:06:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:06:47 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:06:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:47 devstack sudo[91095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba 1073741824 Sep 25 17:06:47 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:47 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba 1073741824" returned: 0 in 0.812s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:47 devstack sudo[91104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba Sep 25 17:06:47 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:48 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba" returned: 0 in 0.416s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.380s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "cinder-quobyte-9043c5d4-2078-496d-8bc5-c4686b14d3da-7f3de59f-92c2-4a8b-99e6-03b94476ab27" by "_create_volume_from_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f12f5a-b8cc-4f99-bc5f-7524fad513e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c4ae2a-c686-4aee-9562-a60866d7517e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-9043c5d4-2078-496d-8bc5-c4686b14d3da-7f3de59f-92c2-4a8b-99e6-03b94476ab27" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Creating volume 7f3de59f-92c2-4a8b-99e6-03b94476ab27 from snapshot 9043c5d4-2078-496d-8bc5-c4686b14d3da {{(pid=87211) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "cinder-quobyte-7f3de59f-92c2-4a8b-99e6-03b94476ab27" by "_copy_volume_from_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:48 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Volume volume-f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba (f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba): created successfully Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c4ae2a-c686-4aee-9562-a60866d7517e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Flow 'volume_create_manager' (ece547c2-7de1-4b29-b0b5-032bcb711d42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-7f3de59f-92c2-4a8b-99e6-03b94476ab27" acquired by "_copy_volume_from_snapshot" :: waited 0.060s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] snapshot: 9043c5d4-2078-496d-8bc5-c4686b14d3da, volume: 7f3de59f-92c2-4a8b-99e6-03b94476ab27, {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:48 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b787f5f0-f4b9-4add-81af-f4cca52ad477 tempest-VolumesActionsTest-1296066307 None] Created volume successfully. Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6585536-9618-4ceb-bb66-ae900e82f8fa]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:06:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:48 devstack sudo[91109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da Sep 25 17:06:48 devstack sudo[91109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:49 devstack sudo[91109]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da" returned: 0 in 0.684s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-002bf1b6-0312-4240-bc22-549260e24159(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:06:49 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[0508d534-0afd-4050-9a55-a5f150fde246]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:06:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:49 devstack sudo[91115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159 Sep 25 17:06:49 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-946a96aa-59f0-48b5-9fe6-33972d134e54 tempest-VolumesActionsTest-1296066307 None] Acquiring lock "cinder-f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-946a96aa-59f0-48b5-9fe6-33972d134e54 tempest-VolumesActionsTest-1296066307 None] Lock "cinder-f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:49 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159" returned: 0 in 0.610s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] will copy from snapshot at /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159 {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:06:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Creating direct copy from snapshot {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:06:49 devstack cinder-volume[87211]: DEBUG cinder.utils [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Path /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7f3de59f-92c2-4a8b-99e6-03b94476ab27 not found in is_blk_device check {{(pid=87211) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:06:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7f3de59f-92c2-4a8b-99e6-03b94476ab27 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:49 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7f3de59f-92c2-4a8b-99e6-03b94476ab27 Sep 25 17:06:49 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-946a96aa-59f0-48b5-9fe6-33972d134e54 tempest-VolumesActionsTest-1296066307 None] Acquiring lock "cinder-quobyte-f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-946a96aa-59f0-48b5-9fe6-33972d134e54 tempest-VolumesActionsTest-1296066307 None] Lock "cinder-quobyte-f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba" acquired by "delete_volume" :: waited 0.027s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:50 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e11ccdf-bea4-47bd-a046-f1a1b227b1fb]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:06:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-946a96aa-59f0-48b5-9fe6-33972d134e54 tempest-VolumesActionsTest-1296066307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:50 devstack sudo[91123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba Sep 25 17:06:50 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:50 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-946a96aa-59f0-48b5-9fe6-33972d134e54 tempest-VolumesActionsTest-1296066307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba" returned: 0 in 0.448s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-946a96aa-59f0-48b5-9fe6-33972d134e54 tempest-VolumesActionsTest-1296066307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:50 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba Sep 25 17:06:50 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:51 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-946a96aa-59f0-48b5-9fe6-33972d134e54 tempest-VolumesActionsTest-1296066307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba" returned: 0 in 0.774s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-946a96aa-59f0-48b5-9fe6-33972d134e54 tempest-VolumesActionsTest-1296066307 None] Lock "cinder-quobyte-f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba" released by "delete_volume" :: held 1.319s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:51 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-946a96aa-59f0-48b5-9fe6-33972d134e54 tempest-VolumesActionsTest-1296066307 None] Created reservations ['96e43aa6-af39-4786-a0cd-583290f54e34', 'fd004324-08f1-4f68-96ad-07bbb7764980', '75e659a4-c9ca-4e25-992f-fd1ff3b5e380', '5b950eea-4b04-45ae-81f9-736783d2306f'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:06:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-946a96aa-59f0-48b5-9fe6-33972d134e54 tempest-VolumesActionsTest-1296066307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-946a96aa-59f0-48b5-9fe6-33972d134e54 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-946a96aa-59f0-48b5-9fe6-33972d134e54 tempest-VolumesActionsTest-1296066307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:06:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-946a96aa-59f0-48b5-9fe6-33972d134e54 tempest-VolumesActionsTest-1296066307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:06:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-946a96aa-59f0-48b5-9fe6-33972d134e54 tempest-VolumesActionsTest-1296066307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-946a96aa-59f0-48b5-9fe6-33972d134e54 tempest-VolumesActionsTest-1296066307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:51 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:06:51 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:52 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-946a96aa-59f0-48b5-9fe6-33972d134e54 tempest-VolumesActionsTest-1296066307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.626s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:52 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-946a96aa-59f0-48b5-9fe6-33972d134e54 tempest-VolumesActionsTest-1296066307 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:06:52 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-946a96aa-59f0-48b5-9fe6-33972d134e54 tempest-VolumesActionsTest-1296066307 None] Deleted volume successfully. Sep 25 17:06:52 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-946a96aa-59f0-48b5-9fe6-33972d134e54 tempest-VolumesActionsTest-1296066307 None] Lock "cinder-f1b65489-7e2c-4eb6-9e77-d57b3d6dfaba-delete_volume" released by "delete_volume" :: held 2.541s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:06:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:06:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:06:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:53 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:06:53 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:54 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 1.173s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:54 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:06:54 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:06:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 8 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:06:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:06:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-70e4299c-bda0-432b-a62e-7ce441d95992 req-8c75d4bc-e999-4e9a-92b1-448bbf37e21c tempest-TaggedAttachmentsTest-685504623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7f3de59f-92c2-4a8b-99e6-03b94476ab27" returned: 0 in 10.665s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:00 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Image conversion details: src /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159, size 1024.00 MB, duration 10.67 sec, destination /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7f3de59f-92c2-4a8b-99e6-03b94476ab27 {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:07:00 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Converted 1024.00 MB image at 95.99 MB/s Sep 25 17:07:00 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7f3de59f-92c2-4a8b-99e6-03b94476ab27 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:07:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7f3de59f-92c2-4a8b-99e6-03b94476ab27 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:00 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7f3de59f-92c2-4a8b-99e6-03b94476ab27 Sep 25 17:07:00 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:00 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7f3de59f-92c2-4a8b-99e6-03b94476ab27" returned: 0 in 0.283s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-7f3de59f-92c2-4a8b-99e6-03b94476ab27" released by "_copy_volume_from_snapshot" :: held 12.442s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-9043c5d4-2078-496d-8bc5-c4686b14d3da-7f3de59f-92c2-4a8b-99e6-03b94476ab27" released by "_create_volume_from_snapshot" :: held 12.572s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.625s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-70e4299c-bda0-432b-a62e-7ce441d95992 req-8c75d4bc-e999-4e9a-92b1-448bbf37e21c tempest-TaggedAttachmentsTest-685504623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.375s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-70e4299c-bda0-432b-a62e-7ce441d95992 req-8c75d4bc-e999-4e9a-92b1-448bbf37e21c tempest-TaggedAttachmentsTest-685504623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-70e4299c-bda0-432b-a62e-7ce441d95992 req-8c75d4bc-e999-4e9a-92b1-448bbf37e21c tempest-TaggedAttachmentsTest-685504623 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-4cbf602f-ccc6-44d1-bb61-a534be63a4b8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12c2edc4-ba25-411f-a7fa-4954fb31216f', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:07:01 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-ff1921fb-0ea5-425c-a0fa-5efdfcbf4e0e tempest-GroupSnapshotsTest-1623939309 None] Create group from source-snapshot-121fadb3-7c2c-4356-bbc4-ecbec12c513c completed successfully. Sep 25 17:07:01 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-70e4299c-bda0-432b-a62e-7ce441d95992 req-8c75d4bc-e999-4e9a-92b1-448bbf37e21c tempest-TaggedAttachmentsTest-685504623 None] attachment_update completed successfully. Sep 25 17:07:02 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-26885303-300f-4fb5-8cb1-36391d21ec4e tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "cinder-quobyte-7f3de59f-92c2-4a8b-99e6-03b94476ab27" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:02 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-26885303-300f-4fb5-8cb1-36391d21ec4e tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-7f3de59f-92c2-4a8b-99e6-03b94476ab27" acquired by "delete_volume" :: waited 0.024s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:02 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4995984f-67ab-482c-afbf-c10222db97c5]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-26885303-300f-4fb5-8cb1-36391d21ec4e tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7f3de59f-92c2-4a8b-99e6-03b94476ab27 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:02 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7f3de59f-92c2-4a8b-99e6-03b94476ab27 Sep 25 17:07:02 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:02 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-26885303-300f-4fb5-8cb1-36391d21ec4e tempest-GroupSnapshotsTest-1623939309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7f3de59f-92c2-4a8b-99e6-03b94476ab27" returned: 0 in 0.542s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-26885303-300f-4fb5-8cb1-36391d21ec4e tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7f3de59f-92c2-4a8b-99e6-03b94476ab27 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:02 devstack sudo[91291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7f3de59f-92c2-4a8b-99e6-03b94476ab27 Sep 25 17:07:02 devstack sudo[91291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:03 devstack sudo[91291]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-26885303-300f-4fb5-8cb1-36391d21ec4e tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7f3de59f-92c2-4a8b-99e6-03b94476ab27" returned: 0 in 0.588s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-26885303-300f-4fb5-8cb1-36391d21ec4e tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-7f3de59f-92c2-4a8b-99e6-03b94476ab27" released by "delete_volume" :: held 1.264s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:03 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-26885303-300f-4fb5-8cb1-36391d21ec4e tempest-GroupSnapshotsTest-1623939309 None] Created reservations ['9321781f-d395-4eb4-a4e9-47d93004251e'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:07:03 devstack cinder-volume[87211]: WARNING cinder.quota [None req-26885303-300f-4fb5-8cb1-36391d21ec4e tempest-GroupSnapshotsTest-1623939309 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-288441008 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-288441008, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:07:03 devstack cinder-volume[87211]: WARNING cinder.quota [None req-26885303-300f-4fb5-8cb1-36391d21ec4e tempest-GroupSnapshotsTest-1623939309 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-288441008 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-288441008, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:07:03 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-26885303-300f-4fb5-8cb1-36391d21ec4e tempest-GroupSnapshotsTest-1623939309 None] Created reservations ['c5aab6ea-2140-4d83-b098-56c2a2e64448', 'd8607cce-a849-4213-90c5-eaa6694e07d7', '186bf6da-53e5-434e-b371-c326a2ca1e0a', 'a29e5c47-9b8a-4553-a288-27acd0900522'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:07:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-26885303-300f-4fb5-8cb1-36391d21ec4e tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-26885303-300f-4fb5-8cb1-36391d21ec4e tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-26885303-300f-4fb5-8cb1-36391d21ec4e tempest-GroupSnapshotsTest-1623939309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:07:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-26885303-300f-4fb5-8cb1-36391d21ec4e tempest-GroupSnapshotsTest-1623939309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:07:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-26885303-300f-4fb5-8cb1-36391d21ec4e tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-26885303-300f-4fb5-8cb1-36391d21ec4e tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:03 devstack sudo[91306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:07:03 devstack sudo[91306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:04 devstack sudo[91306]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-26885303-300f-4fb5-8cb1-36391d21ec4e tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.349s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:04 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-26885303-300f-4fb5-8cb1-36391d21ec4e tempest-GroupSnapshotsTest-1623939309 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:07:04 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-26885303-300f-4fb5-8cb1-36391d21ec4e tempest-GroupSnapshotsTest-1623939309 None] Delete group completed successfully. Sep 25 17:07:04 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-8dd5c9a1-719c-4ee6-bd58-1df2744e5f1f req-57657c6a-4f58-4523-9fcb-c36858376a02 tempest-TaggedAttachmentsTest-685504623 None] Terminate volume connection completed successfully. Sep 25 17:07:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-8dd5c9a1-719c-4ee6-bd58-1df2744e5f1f req-57657c6a-4f58-4523-9fcb-c36858376a02 tempest-TaggedAttachmentsTest-685504623 None] Deleting attachment 12c2edc4-ba25-411f-a7fa-4954fb31216f. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:07:04 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b630a531-8ae1-403d-ae16-a6480d93e798 tempest-GroupSnapshotsTest-1623939309 None] group_snapshot 121fadb3-7c2c-4356-bbc4-ecbec12c513c: deleting Sep 25 17:07:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b630a531-8ae1-403d-ae16-a6480d93e798 tempest-GroupSnapshotsTest-1623939309 None] group_snapshot 121fadb3-7c2c-4356-bbc4-ecbec12c513c: deleting {{(pid=87211) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 17:07:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b630a531-8ae1-403d-ae16-a6480d93e798 tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "cinder-quobyte-002bf1b6-0312-4240-bc22-549260e24159" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b630a531-8ae1-403d-ae16-a6480d93e798 tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-002bf1b6-0312-4240-bc22-549260e24159" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b630a531-8ae1-403d-ae16-a6480d93e798 tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "cinder-quobyte-9043c5d4-2078-496d-8bc5-c4686b14d3da" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b630a531-8ae1-403d-ae16-a6480d93e798 tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-9043c5d4-2078-496d-8bc5-c4686b14d3da" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:04 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b630a531-8ae1-403d-ae16-a6480d93e798 tempest-GroupSnapshotsTest-1623939309 None] Deleting offline snapshot 9043c5d4-2078-496d-8bc5-c4686b14d3da of volume 002bf1b6-0312-4240-bc22-549260e24159 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:07:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b630a531-8ae1-403d-ae16-a6480d93e798 tempest-GroupSnapshotsTest-1623939309 None] snapshot_file for this snap is: volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:07:05 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb3a93b-2baa-42cb-be76-bccf43570e66]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b630a531-8ae1-403d-ae16-a6480d93e798 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:05 devstack sudo[91349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da Sep 25 17:07:05 devstack sudo[91349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:05 devstack sudo[91349]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b630a531-8ae1-403d-ae16-a6480d93e798 tempest-GroupSnapshotsTest-1623939309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da" returned: 0 in 0.547s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b630a531-8ae1-403d-ae16-a6480d93e798 tempest-GroupSnapshotsTest-1623939309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-002bf1b6-0312-4240-bc22-549260e24159(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:07:05 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fa84d8-6b75-4de0-a1e5-b0d05f8b906a]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b630a531-8ae1-403d-ae16-a6480d93e798 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:05 devstack sudo[91363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159 Sep 25 17:07:05 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:06 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b630a531-8ae1-403d-ae16-a6480d93e798 tempest-GroupSnapshotsTest-1623939309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159" returned: 0 in 0.735s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b630a531-8ae1-403d-ae16-a6480d93e798 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:06 devstack sudo[91381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da Sep 25 17:07:06 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:06 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b630a531-8ae1-403d-ae16-a6480d93e798 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da" returned: 0 in 0.508s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b630a531-8ae1-403d-ae16-a6480d93e798 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:06 devstack sudo[91389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da Sep 25 17:07:06 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:07 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b630a531-8ae1-403d-ae16-a6480d93e798 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159.9043c5d4-2078-496d-8bc5-c4686b14d3da" returned: 0 in 0.284s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b630a531-8ae1-403d-ae16-a6480d93e798 tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-9043c5d4-2078-496d-8bc5-c4686b14d3da" released by "_delete_snapshot" :: held 2.215s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b630a531-8ae1-403d-ae16-a6480d93e798 tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-002bf1b6-0312-4240-bc22-549260e24159" released by "delete_snapshot" :: held 2.242s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:07 devstack cinder-volume[87211]: WARNING cinder.quota [None req-b630a531-8ae1-403d-ae16-a6480d93e798 tempest-GroupSnapshotsTest-1623939309 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-288441008 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-288441008, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:07:07 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-b630a531-8ae1-403d-ae16-a6480d93e798 tempest-GroupSnapshotsTest-1623939309 None] Created reservations ['9b47d723-f594-44e4-8645-f9762789a476', '9f0ade74-6d09-4544-bd08-be6341fe7a5d', '831acddf-2cf9-400f-be2a-7b87ba5a0d3c', '7da4b8bf-49f0-4998-a537-b9c04c58e05f'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:07:07 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b630a531-8ae1-403d-ae16-a6480d93e798 tempest-GroupSnapshotsTest-1623939309 None] group_snapshot 121fadb3-7c2c-4356-bbc4-ecbec12c513c: deleted successfully Sep 25 17:07:08 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=121,cinder:INSERT=23,cinder:UPDATE=107,cinder:DELETE=9 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:07:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-37ed3368-e89d-4c46-911d-25ceb59ec942 tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "cinder-quobyte-002bf1b6-0312-4240-bc22-549260e24159" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-37ed3368-e89d-4c46-911d-25ceb59ec942 tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-002bf1b6-0312-4240-bc22-549260e24159" acquired by "delete_volume" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:08 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cc44a3-a55f-4feb-a570-0f56cebab2d5]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-37ed3368-e89d-4c46-911d-25ceb59ec942 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:09 devstack sudo[91393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159 Sep 25 17:07:09 devstack sudo[91393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:09 devstack sudo[91393]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-37ed3368-e89d-4c46-911d-25ceb59ec942 tempest-GroupSnapshotsTest-1623939309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159" returned: 0 in 0.574s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-37ed3368-e89d-4c46-911d-25ceb59ec942 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:09 devstack sudo[91400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159 Sep 25 17:07:09 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:09 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-37ed3368-e89d-4c46-911d-25ceb59ec942 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-002bf1b6-0312-4240-bc22-549260e24159" returned: 0 in 0.338s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:09 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-37ed3368-e89d-4c46-911d-25ceb59ec942 tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-002bf1b6-0312-4240-bc22-549260e24159" released by "delete_volume" :: held 1.055s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:09 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:UPDATE=117,cinder:SELECT=98,cinder:DELETE=6,cinder:INSERT=26 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:07:09 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-37ed3368-e89d-4c46-911d-25ceb59ec942 tempest-GroupSnapshotsTest-1623939309 None] Created reservations ['66ea5a70-5173-42c9-8a10-3ae09702eed4'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:07:10 devstack cinder-volume[87211]: WARNING cinder.db.api [None req-37ed3368-e89d-4c46-911d-25ceb59ec942 tempest-GroupSnapshotsTest-1623939309 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-288441008'] Sep 25 17:07:10 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-37ed3368-e89d-4c46-911d-25ceb59ec942 tempest-GroupSnapshotsTest-1623939309 None] Created reservations ['5c543444-ee29-46bd-b3a7-ca906357a4e9', 'fd101d19-ea99-4e74-a3f4-2e555d5b6abd', 'bde74c1f-ac03-48c8-99d2-6d72bf33b212', '19d072e3-2e26-4e75-a072-9a3b4d556ccb'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:07:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-37ed3368-e89d-4c46-911d-25ceb59ec942 tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-37ed3368-e89d-4c46-911d-25ceb59ec942 tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-37ed3368-e89d-4c46-911d-25ceb59ec942 tempest-GroupSnapshotsTest-1623939309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:07:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-37ed3368-e89d-4c46-911d-25ceb59ec942 tempest-GroupSnapshotsTest-1623939309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:07:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-37ed3368-e89d-4c46-911d-25ceb59ec942 tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-37ed3368-e89d-4c46-911d-25ceb59ec942 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:10 devstack sudo[91423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:07:10 devstack sudo[91423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:10 devstack sudo[91423]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-37ed3368-e89d-4c46-911d-25ceb59ec942 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.380s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:10 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-37ed3368-e89d-4c46-911d-25ceb59ec942 tempest-GroupSnapshotsTest-1623939309 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:07:10 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-37ed3368-e89d-4c46-911d-25ceb59ec942 tempest-GroupSnapshotsTest-1623939309 None] Delete group completed successfully. Sep 25 17:07:11 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-8e2de374-814a-4a48-a867-8db210f0f1e5 tempest-GroupSnapshotsTest-1623939309 None] Group tempest-GroupSnapshotsTest-Group-1549026279: creating Sep 25 17:07:11 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-8e2de374-814a-4a48-a867-8db210f0f1e5 tempest-GroupSnapshotsTest-1623939309 None] Group tempest-GroupSnapshotsTest-Group-1549026279: created successfully Sep 25 17:07:11 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-8e2de374-814a-4a48-a867-8db210f0f1e5 tempest-GroupSnapshotsTest-1623939309 None] Create group completed successfully. Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Flow 'volume_create_manager' (ba63283d-340d-4031-9554-ddf3225b6f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a7702f6-8cd1-4191-b039-087ec2afdd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a7702f6-8cd1-4191-b039-087ec2afdd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1383201145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=884cfa69-c05b-436f-956e-1d3b62f8dcda,host='devstack@QuobyteHD#QuobyteHD',id=7386b2ff-e9ac-4717-a71f-56bb1826253e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b588af0f4f46446da58a50cbd4f6a420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:13Z,use_quota=True,user_id='11edca724f1e44369423a6b59b027cbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53fd8392-3b62-4377-901c-140d1d3b9c7c),volume_type_id=53fd8392-3b62-4377-901c-140d1d3b9c7c)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52a4d00-de91-4e35-94e6-71051ed72249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52a4d00-de91-4e35-94e6-71051ed72249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457efc3f-3523-4171-9469-121ab7c6c9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457efc3f-3523-4171-9469-121ab7c6c9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7386b2ff-e9ac-4717-a71f-56bb1826253e', 'volume_name': 'volume-7386b2ff-e9ac-4717-a71f-56bb1826253e', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423e4e78-0526-4897-8bd8-a3d3cad2658e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423e4e78-0526-4897-8bd8-a3d3cad2658e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e508dfd8-fb70-4423-aeb7-e47199a5daca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:13 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Volume 7386b2ff-e9ac-4717-a71f-56bb1826253e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7386b2ff-e9ac-4717-a71f-56bb1826253e', 'volume_size': 1} Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=884cfa69-c05b-436f-956e-1d3b62f8dcda,created_at=2026-09-25T15:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1383201145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=884cfa69-c05b-436f-956e-1d3b62f8dcda,host='devstack@QuobyteHD#QuobyteHD',id=7386b2ff-e9ac-4717-a71f-56bb1826253e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b588af0f4f46446da58a50cbd4f6a420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:13Z,use_quota=True,user_id='11edca724f1e44369423a6b59b027cbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53fd8392-3b62-4377-901c-140d1d3b9c7c),volume_type_id=53fd8392-3b62-4377-901c-140d1d3b9c7c)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Creating volume 7386b2ff-e9ac-4717-a71f-56bb1826253e {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:07:13 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:13 devstack sudo[91445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e 1073741824 Sep 25 17:07:13 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:13 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-d07f8252-3256-49fd-b89b-1c7cbe72036c req-3ad9ae4e-42ce-40dc-b6c9-213d4dfd7513 tempest-ServerActionsTestOtherA-902126569 None] Terminate volume connection completed successfully. Sep 25 17:07:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-d07f8252-3256-49fd-b89b-1c7cbe72036c req-3ad9ae4e-42ce-40dc-b6c9-213d4dfd7513 tempest-ServerActionsTestOtherA-902126569 None] Deleting attachment 143c07ab-6736-4ff9-8f45-86c17e1542db. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:07:14 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e 1073741824" returned: 0 in 0.738s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:14 devstack sudo[91454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e Sep 25 17:07:14 devstack sudo[91454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:14 devstack sudo[91454]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e" returned: 0 in 0.388s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:07:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e508dfd8-fb70-4423-aeb7-e47199a5daca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7386b2ff-e9ac-4717-a71f-56bb1826253e', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8604346-f09f-4829-b878-ae25b681dbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:14 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Volume volume-7386b2ff-e9ac-4717-a71f-56bb1826253e (7386b2ff-e9ac-4717-a71f-56bb1826253e): created successfully Sep 25 17:07:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8604346-f09f-4829-b878-ae25b681dbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Flow 'volume_create_manager' (ba63283d-340d-4031-9554-ddf3225b6f35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:07:14 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-28295b7c-4e4a-4c72-82f4-2425a4dfab9b tempest-GroupSnapshotsTest-1623939309 None] Created volume successfully. Sep 25 17:07:16 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:07:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Flow 'volume_create_manager' (f112fa19-8563-4e91-85fa-e4b6c861837d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:07:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40cd28a-05c0-4495-b9cc-e7a3c1fe8cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40cd28a-05c0-4495-b9cc-e7a3c1fe8cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-656009084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=884cfa69-c05b-436f-956e-1d3b62f8dcda,host='devstack@QuobyteHD#QuobyteHD',id=d849495c-3631-4f37-9e7c-113a0fba4cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b588af0f4f46446da58a50cbd4f6a420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:17Z,use_quota=True,user_id='11edca724f1e44369423a6b59b027cbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53fd8392-3b62-4377-901c-140d1d3b9c7c),volume_type_id=53fd8392-3b62-4377-901c-140d1d3b9c7c)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ca840d4-5809-4be3-afc1-2e2271dfc59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ca840d4-5809-4be3-afc1-2e2271dfc59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c0beb3-ff3b-4cb0-b31d-e900a1001341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c0beb3-ff3b-4cb0-b31d-e900a1001341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd849495c-3631-4f37-9e7c-113a0fba4cf2', 'volume_name': 'volume-d849495c-3631-4f37-9e7c-113a0fba4cf2', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b81f18-5543-4d4f-a22e-6c209626d433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b81f18-5543-4d4f-a22e-6c209626d433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc59e91-ef22-4f39-b428-d513f4ecd568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:16 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Volume d849495c-3631-4f37-9e7c-113a0fba4cf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d849495c-3631-4f37-9e7c-113a0fba4cf2', 'volume_size': 1} Sep 25 17:07:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=884cfa69-c05b-436f-956e-1d3b62f8dcda,created_at=2026-09-25T15:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-656009084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=884cfa69-c05b-436f-956e-1d3b62f8dcda,host='devstack@QuobyteHD#QuobyteHD',id=d849495c-3631-4f37-9e7c-113a0fba4cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b588af0f4f46446da58a50cbd4f6a420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:17Z,use_quota=True,user_id='11edca724f1e44369423a6b59b027cbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53fd8392-3b62-4377-901c-140d1d3b9c7c),volume_type_id=53fd8392-3b62-4377-901c-140d1d3b9c7c)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:07:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Creating volume d849495c-3631-4f37-9e7c-113a0fba4cf2 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:07:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:07:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:07:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:07:16 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:07:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:16 devstack sudo[91488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2 1073741824 Sep 25 17:07:16 devstack sudo[91488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:17 devstack sudo[91488]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2 1073741824" returned: 0 in 0.641s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:17 devstack sudo[91497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2 Sep 25 17:07:17 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d3264bbc-7f76-4307-92eb-85e0402b26cb tempest-TaggedAttachmentsTest-685504623 None] Acquiring lock "cinder-4cbf602f-ccc6-44d1-bb61-a534be63a4b8-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d3264bbc-7f76-4307-92eb-85e0402b26cb tempest-TaggedAttachmentsTest-685504623 None] Lock "cinder-4cbf602f-ccc6-44d1-bb61-a534be63a4b8-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d3264bbc-7f76-4307-92eb-85e0402b26cb tempest-TaggedAttachmentsTest-685504623 None] Acquiring lock "cinder-quobyte-4cbf602f-ccc6-44d1-bb61-a534be63a4b8" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d3264bbc-7f76-4307-92eb-85e0402b26cb tempest-TaggedAttachmentsTest-685504623 None] Lock "cinder-quobyte-4cbf602f-ccc6-44d1-bb61-a534be63a4b8" acquired by "delete_volume" :: waited 0.028s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:17 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2" returned: 0 in 0.454s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:07:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:17 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[2079c07f-928a-4e43-a7b0-273a9a2c843c]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d3264bbc-7f76-4307-92eb-85e0402b26cb tempest-TaggedAttachmentsTest-685504623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4cbf602f-ccc6-44d1-bb61-a534be63a4b8 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc59e91-ef22-4f39-b428-d513f4ecd568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d849495c-3631-4f37-9e7c-113a0fba4cf2', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7eb457-3ee9-48e1-8bd6-05586b00a109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:17 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Volume volume-d849495c-3631-4f37-9e7c-113a0fba4cf2 (d849495c-3631-4f37-9e7c-113a0fba4cf2): created successfully Sep 25 17:07:18 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7eb457-3ee9-48e1-8bd6-05586b00a109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:18 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Flow 'volume_create_manager' (f112fa19-8563-4e91-85fa-e4b6c861837d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:07:18 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-8f92e751-34a1-4648-92da-3973381f59de tempest-GroupSnapshotsTest-1623939309 None] Created volume successfully. Sep 25 17:07:18 devstack sudo[91502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4cbf602f-ccc6-44d1-bb61-a534be63a4b8 Sep 25 17:07:18 devstack sudo[91502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:18 devstack sudo[91502]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d3264bbc-7f76-4307-92eb-85e0402b26cb tempest-TaggedAttachmentsTest-685504623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4cbf602f-ccc6-44d1-bb61-a534be63a4b8" returned: 0 in 0.455s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d3264bbc-7f76-4307-92eb-85e0402b26cb tempest-TaggedAttachmentsTest-685504623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4cbf602f-ccc6-44d1-bb61-a534be63a4b8 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:18 devstack sudo[91507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4cbf602f-ccc6-44d1-bb61-a534be63a4b8 Sep 25 17:07:18 devstack sudo[91507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:18 devstack sudo[91507]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d3264bbc-7f76-4307-92eb-85e0402b26cb tempest-TaggedAttachmentsTest-685504623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4cbf602f-ccc6-44d1-bb61-a534be63a4b8" returned: 0 in 0.261s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:18 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d3264bbc-7f76-4307-92eb-85e0402b26cb tempest-TaggedAttachmentsTest-685504623 None] Lock "cinder-quobyte-4cbf602f-ccc6-44d1-bb61-a534be63a4b8" released by "delete_volume" :: held 0.792s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:18 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-d3264bbc-7f76-4307-92eb-85e0402b26cb tempest-TaggedAttachmentsTest-685504623 None] Created reservations ['aa4e4dec-db17-4132-949e-3d7a36bd90aa', '9ec33254-8ef2-467b-82d9-75a75952e5ab', 'ac213141-8f36-4749-9f45-3504a0265911', 'e8791d64-bb6e-4b2d-bf4f-e7a8797fcc1e'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:07:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d3264bbc-7f76-4307-92eb-85e0402b26cb tempest-TaggedAttachmentsTest-685504623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d3264bbc-7f76-4307-92eb-85e0402b26cb tempest-TaggedAttachmentsTest-685504623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:18 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d3264bbc-7f76-4307-92eb-85e0402b26cb tempest-TaggedAttachmentsTest-685504623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:07:18 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d3264bbc-7f76-4307-92eb-85e0402b26cb tempest-TaggedAttachmentsTest-685504623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:07:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d3264bbc-7f76-4307-92eb-85e0402b26cb tempest-TaggedAttachmentsTest-685504623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d3264bbc-7f76-4307-92eb-85e0402b26cb tempest-TaggedAttachmentsTest-685504623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:18 devstack sudo[91510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:07:18 devstack sudo[91510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:19 devstack sudo[91510]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d3264bbc-7f76-4307-92eb-85e0402b26cb tempest-TaggedAttachmentsTest-685504623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.420s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:19 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-d3264bbc-7f76-4307-92eb-85e0402b26cb tempest-TaggedAttachmentsTest-685504623 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:07:19 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-d3264bbc-7f76-4307-92eb-85e0402b26cb tempest-TaggedAttachmentsTest-685504623 None] Deleted volume successfully. Sep 25 17:07:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d3264bbc-7f76-4307-92eb-85e0402b26cb tempest-TaggedAttachmentsTest-685504623 None] Lock "cinder-4cbf602f-ccc6-44d1-bb61-a534be63a4b8-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:19 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-555d3115-731a-4c57-88b3-40cd9ec592f4 tempest-GroupSnapshotsTest-1623939309 None] Update group completed successfully. Sep 25 17:07:20 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-a4b1386f-0ea6-472c-b5e4-037141dc4665 tempest-GroupSnapshotsTest-1623939309 None] Update group completed successfully. Sep 25 17:07:21 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-5d9f34a5-c746-4e3d-b874-f0709a834da8 tempest-GroupSnapshotsTest-1623939309 None] Update group completed successfully. Sep 25 17:07:21 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:07:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Flow 'volume_create_manager' (92a4392b-82ab-4a6a-9b8e-0c5096e77118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:07:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e27b09-4775-4ed7-9697-ee03bdad386f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e27b09-4775-4ed7-9697-ee03bdad386f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2065521976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f361279-5c6a-45af-87b0-528e57c3d04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b05981f28a7343268665261e6675af4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:22Z,use_quota=True,user_id='d2f84ac302ac4d718d48ca42e07783af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb1e6ae-6256-4a38-a5ae-30ca152b3e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb1e6ae-6256-4a38-a5ae-30ca152b3e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ce20ff0-fb4c-4982-9058-647848cb01e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ce20ff0-fb4c-4982-9058-647848cb01e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f361279-5c6a-45af-87b0-528e57c3d04b', 'volume_name': 'volume-0f361279-5c6a-45af-87b0-528e57c3d04b', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb846fe-0c6a-4740-838d-26a39fa5a85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb846fe-0c6a-4740-838d-26a39fa5a85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0d7ef7-10d7-4e01-b8e4-c22556989b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:21 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Volume 0f361279-5c6a-45af-87b0-528e57c3d04b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f361279-5c6a-45af-87b0-528e57c3d04b', 'volume_size': 1} Sep 25 17:07:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:21 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2065521976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f361279-5c6a-45af-87b0-528e57c3d04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b05981f28a7343268665261e6675af4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:22Z,use_quota=True,user_id='d2f84ac302ac4d718d48ca42e07783af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:07:21 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Creating volume 0f361279-5c6a-45af-87b0-528e57c3d04b {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:07:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:21 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:07:21 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:07:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:21 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:07:21 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:07:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:21 devstack sudo[91514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b 1073741824 Sep 25 17:07:21 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:22 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:07:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Flow 'volume_create_manager' (5857e4be-a4ee-4173-8b34-9dee57abdb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:07:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb0af7a-e689-4bb6-90bf-a55b6b561c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb0af7a-e689-4bb6-90bf-a55b6b561c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1304980877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73576bfa-8140-4462-9241-7fa212287974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5354770568624a06b3ce8e055e20e91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:22Z,use_quota=True,user_id='e06666017f604b0e8438ffc24e236a71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac136b05-c58f-424f-a30c-d7b4dcfc4885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac136b05-c58f-424f-a30c-d7b4dcfc4885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6643600-3068-4284-9246-00da1d801d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:22 devstack cinder-volume[87211]: DEBUG cinder.image.glance [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Creating Keystone auth plugin from conf {{(pid=87211) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 17:07:22 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b 1073741824" returned: 0 in 0.575s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6643600-3068-4284-9246-00da1d801d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '73576bfa-8140-4462-9241-7fa212287974', 'volume_name': 'volume-73576bfa-8140-4462-9241-7fa212287974', 'volume_size': 1, 'image_id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'acaf9a5e9cfc4af3b32eda10c91e30fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'created_at': datetime.datetime(2026, 9, 25, 14, 58, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6daf7a-4793-45f6-85cd-3494a58fbb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6daf7a-4793-45f6-85cd-3494a58fbb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (350c580b-4996-47f9-86d2-4aadd79546e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:22 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Volume 73576bfa-8140-4462-9241-7fa212287974: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-73576bfa-8140-4462-9241-7fa212287974', 'volume_size': 1, 'image_id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'acaf9a5e9cfc4af3b32eda10c91e30fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'created_at': datetime.datetime(2026, 9, 25, 14, 58, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 17:07:22 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Trying to clone 73576bfa-8140-4462-9241-7fa212287974 from image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}]). {{(pid=87211) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 17:07:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:22 devstack sudo[91519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b Sep 25 17:07:22 devstack sudo[91519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:22 devstack sudo[91519]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b" returned: 0 in 0.333s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:07:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0d7ef7-10d7-4e01-b8e4-c22556989b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f361279-5c6a-45af-87b0-528e57c3d04b', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1abaf0cc-f11d-4969-863d-5c628ee2f913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:22 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0__3j9sd1edevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 17:07:22 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Image download 20.69 MB at 20.69 MB/s Sep 25 17:07:23 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Volume volume-0f361279-5c6a-45af-87b0-528e57c3d04b (0f361279-5c6a-45af-87b0-528e57c3d04b): created successfully Sep 25 17:07:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1abaf0cc-f11d-4969-863d-5c628ee2f913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Flow 'volume_create_manager' (92a4392b-82ab-4a6a-9b8e-0c5096e77118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:07:23 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3aa67f6-d1e5-4d7f-8f5b-8a97d14ffa40]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0__3j9sd1edevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:23 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-19537f9c-186a-4e17-bb5f-e0f9fe21ebb1 tempest-SnapshotMetadataTestJSON-593672773 None] Created volume successfully. Sep 25 17:07:23 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-16577402-a3c5-4a97-838c-30c34f14a19f tempest-GroupSnapshotsTest-1623939309 None] Update group completed successfully. Sep 25 17:07:23 devstack sudo[91543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0__3j9sd1edevstack@QuobyteHD Sep 25 17:07:23 devstack sudo[91543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:23 devstack sudo[91543]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0__3j9sd1edevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:23 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Temporary image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 is fetched for user e06666017f604b0e8438ffc24e236a71. {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 17:07:23 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[81638e3d-4d02-4572-9bf3-3099552ba2ea]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0__3j9sd1edevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:23 devstack sudo[91548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0__3j9sd1edevstack@QuobyteHD Sep 25 17:07:23 devstack sudo[91548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:23 devstack sudo[91548]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0__3j9sd1edevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1304980877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73576bfa-8140-4462-9241-7fa212287974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5354770568624a06b3ce8e055e20e91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:22Z,use_quota=True,user_id='e06666017f604b0e8438ffc24e236a71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:07:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Creating volume 73576bfa-8140-4462-9241-7fa212287974 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:07:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:07:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:07:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:07:23 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:07:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-73576bfa-8140-4462-9241-7fa212287974 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:23 devstack sudo[91553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-73576bfa-8140-4462-9241-7fa212287974 1073741824 Sep 25 17:07:23 devstack sudo[91553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-01e4d984-d1b0-40d2-8a76-a81148106d8b tempest-SnapshotMetadataTestJSON-593672773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:24 devstack sudo[91553]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-73576bfa-8140-4462-9241-7fa212287974 1073741824" returned: 0 in 0.625s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-73576bfa-8140-4462-9241-7fa212287974 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:24 devstack sudo[91561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-73576bfa-8140-4462-9241-7fa212287974 Sep 25 17:07:24 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:24 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] GroupSnapshot 13fb371a-640d-4b16-8876-ad12869db173: creating. Sep 25 17:07:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] Group snapshot 13fb371a-640d-4b16-8876-ad12869db173: creating. {{(pid=87211) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 17:07:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:24 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-73576bfa-8140-4462-9241-7fa212287974" returned: 0 in 0.293s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:07:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-01e4d984-d1b0-40d2-8a76-a81148106d8b tempest-SnapshotMetadataTestJSON-593672773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.797s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-01e4d984-d1b0-40d2-8a76-a81148106d8b tempest-SnapshotMetadataTestJSON-593672773 None] Creating offline snapshot 7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa of volume 0f361279-5c6a-45af-87b0-528e57c3d04b {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:07:24 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6aa13c-3a12-4b10-b3cc-b73b2601433f]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-01e4d984-d1b0-40d2-8a76-a81148106d8b tempest-SnapshotMetadataTestJSON-593672773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:24 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Attempting download of 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}])) to volume 73576bfa-8140-4462-9241-7fa212287974. {{(pid=87211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 17:07:25 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[618919bf-c391-493b-842f-945f5b6e3668]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_x1mv9kuz {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:25 devstack sudo[91564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b Sep 25 17:07:25 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:25 devstack sudo[91565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_x1mv9kuz Sep 25 17:07:25 devstack sudo[91565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:25 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-01e4d984-d1b0-40d2-8a76-a81148106d8b tempest-SnapshotMetadataTestJSON-593672773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b" returned: 0 in 0.472s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-01e4d984-d1b0-40d2-8a76-a81148106d8b tempest-SnapshotMetadataTestJSON-593672773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:25 devstack sudo[91574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa 1G Sep 25 17:07:25 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:25 devstack sudo[91565]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_x1mv9kuz" returned: 0 in 0.404s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_x1mv9kuz {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:25 devstack sudo[91576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_x1mv9kuz Sep 25 17:07:25 devstack sudo[91576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:25 devstack sudo[91576]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_x1mv9kuz" returned: 1 in 0.391s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_x1mv9kuz' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:07:25 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[faefcaad-facc-417e-9987-70289d4be6fa]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0__3j9sd1edevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:25 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-01e4d984-d1b0-40d2-8a76-a81148106d8b tempest-SnapshotMetadataTestJSON-593672773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa 1G" returned: 0 in 0.478s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-01e4d984-d1b0-40d2-8a76-a81148106d8b tempest-SnapshotMetadataTestJSON-593672773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f361279-5c6a-45af-87b0-528e57c3d04b -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:25 devstack sudo[91588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f361279-5c6a-45af-87b0-528e57c3d04b -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa Sep 25 17:07:25 devstack sudo[91588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:25 devstack sudo[91587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0__3j9sd1edevstack@QuobyteHD Sep 25 17:07:25 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:26 devstack sudo[91588]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-01e4d984-d1b0-40d2-8a76-a81148106d8b tempest-SnapshotMetadataTestJSON-593672773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f361279-5c6a-45af-87b0-528e57c3d04b -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa" returned: 0 in 0.338s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:26 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-01e4d984-d1b0-40d2-8a76-a81148106d8b tempest-SnapshotMetadataTestJSON-593672773 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa is being set with open permissions: ugo+rw Sep 25 17:07:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-01e4d984-d1b0-40d2-8a76-a81148106d8b tempest-SnapshotMetadataTestJSON-593672773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:26 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0__3j9sd1edevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:26 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 was qcow2, converting to qcow2 {{(pid=87211) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 17:07:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0__3j9sd1edevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-73576bfa-8140-4462-9241-7fa212287974 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:26 devstack sudo[91599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa Sep 25 17:07:26 devstack sudo[91599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:26 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0__3j9sd1edevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-73576bfa-8140-4462-9241-7fa212287974 Sep 25 17:07:26 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:26 devstack sudo[91599]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-01e4d984-d1b0-40d2-8a76-a81148106d8b tempest-SnapshotMetadataTestJSON-593672773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa" returned: 0 in 0.271s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-01e4d984-d1b0-40d2-8a76-a81148106d8b tempest-SnapshotMetadataTestJSON-593672773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:26 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.info Sep 25 17:07:26 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:26 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-01e4d984-d1b0-40d2-8a76-a81148106d8b tempest-SnapshotMetadataTestJSON-593672773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.info" returned: 0 in 0.326s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:26 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-01e4d984-d1b0-40d2-8a76-a81148106d8b tempest-SnapshotMetadataTestJSON-593672773 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.info is being set with open permissions: ugo+rw Sep 25 17:07:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-01e4d984-d1b0-40d2-8a76-a81148106d8b tempest-SnapshotMetadataTestJSON-593672773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:26 devstack sudo[91613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.info Sep 25 17:07:26 devstack sudo[91613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:27 devstack sudo[91613]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-01e4d984-d1b0-40d2-8a76-a81148106d8b tempest-SnapshotMetadataTestJSON-593672773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.info" returned: 0 in 0.288s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-01e4d984-d1b0-40d2-8a76-a81148106d8b tempest-SnapshotMetadataTestJSON-593672773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.309s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.444s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] Creating offline snapshot 211462fb-ce10-47b1-a8ad-459598652a26 of volume 7386b2ff-e9ac-4717-a71f-56bb1826253e {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:07:27 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-01e4d984-d1b0-40d2-8a76-a81148106d8b tempest-SnapshotMetadataTestJSON-593672773 None] Create snapshot completed successfully Sep 25 17:07:27 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[934753c2-c234-4774-aaab-e9dc53037858]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:27 devstack sudo[91617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e Sep 25 17:07:27 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:27 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e" returned: 0 in 0.446s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.211462fb-ce10-47b1-a8ad-459598652a26 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:27 devstack sudo[91623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.211462fb-ce10-47b1-a8ad-459598652a26 1G Sep 25 17:07:27 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:28 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.211462fb-ce10-47b1-a8ad-459598652a26 1G" returned: 0 in 0.515s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7386b2ff-e9ac-4717-a71f-56bb1826253e -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.211462fb-ce10-47b1-a8ad-459598652a26 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:28 devstack sudo[91629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7386b2ff-e9ac-4717-a71f-56bb1826253e -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.211462fb-ce10-47b1-a8ad-459598652a26 Sep 25 17:07:28 devstack sudo[91629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:28 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0__3j9sd1edevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-73576bfa-8140-4462-9241-7fa212287974" returned: 0 in 2.368s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:28 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0__3j9sd1edevstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-73576bfa-8140-4462-9241-7fa212287974 {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:07:28 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Converted 112.00 MB image at 47.26 MB/s Sep 25 17:07:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-73576bfa-8140-4462-9241-7fa212287974 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:28 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-73576bfa-8140-4462-9241-7fa212287974 1G Sep 25 17:07:28 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:28 devstack sudo[91629]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7386b2ff-e9ac-4717-a71f-56bb1826253e -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.211462fb-ce10-47b1-a8ad-459598652a26" returned: 0 in 0.465s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:28 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.211462fb-ce10-47b1-a8ad-459598652a26 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:07:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.211462fb-ce10-47b1-a8ad-459598652a26 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:28 devstack sudo[91670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.211462fb-ce10-47b1-a8ad-459598652a26 Sep 25 17:07:28 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:29 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.211462fb-ce10-47b1-a8ad-459598652a26" returned: 0 in 0.506s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:29 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-73576bfa-8140-4462-9241-7fa212287974 1G" returned: 0 in 0.670s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Downloaded image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}])) to volume 73576bfa-8140-4462-9241-7fa212287974 successfully. {{(pid=87211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 17:07:29 devstack sudo[91679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.info Sep 25 17:07:29 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Temporary image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 for user e06666017f604b0e8438ffc24e236a71 is deleted. {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Marking volume 73576bfa-8140-4462-9241-7fa212287974 as bootable. {{(pid=87211) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Copying metadata from image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 to 73576bfa-8140-4462-9241-7fa212287974. {{(pid=87211) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Creating volume glance metadata for volume 73576bfa-8140-4462-9241-7fa212287974 backed by image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87211) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (350c580b-4996-47f9-86d2-4aadd79546e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73576bfa-8140-4462-9241-7fa212287974', 'volume_size': 1, 'image_id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'acaf9a5e9cfc4af3b32eda10c91e30fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'created_at': datetime.datetime(2026, 9, 25, 14, 58, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c509a6bb-fc04-469a-aaa0-c0e553b88091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:29 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Volume volume-73576bfa-8140-4462-9241-7fa212287974 (73576bfa-8140-4462-9241-7fa212287974): created successfully Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c509a6bb-fc04-469a-aaa0-c0e553b88091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Flow 'volume_create_manager' (5857e4be-a4ee-4173-8b34-9dee57abdb88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-99c43724-88e8-4817-afe0-0f6408189092 tempest-SnapshotMetadataTestJSON-593672773 None] Acquiring lock "cinder-7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:29 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-8ead82ed-9f64-4485-9b93-19bb8815f7f6 tempest-ServerActionsTestOtherA-902126569 None] Created volume successfully. Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-99c43724-88e8-4817-afe0-0f6408189092 tempest-SnapshotMetadataTestJSON-593672773 None] Lock "cinder-7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-99c43724-88e8-4817-afe0-0f6408189092 tempest-SnapshotMetadataTestJSON-593672773 None] Acquiring lock "cinder-quobyte-0f361279-5c6a-45af-87b0-528e57c3d04b" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-99c43724-88e8-4817-afe0-0f6408189092 tempest-SnapshotMetadataTestJSON-593672773 None] Lock "cinder-quobyte-0f361279-5c6a-45af-87b0-528e57c3d04b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-99c43724-88e8-4817-afe0-0f6408189092 tempest-SnapshotMetadataTestJSON-593672773 None] Acquiring lock "cinder-quobyte-7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-99c43724-88e8-4817-afe0-0f6408189092 tempest-SnapshotMetadataTestJSON-593672773 None] Lock "cinder-quobyte-7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-99c43724-88e8-4817-afe0-0f6408189092 tempest-SnapshotMetadataTestJSON-593672773 None] Deleting offline snapshot 7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa of volume 0f361279-5c6a-45af-87b0-528e57c3d04b {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-99c43724-88e8-4817-afe0-0f6408189092 tempest-SnapshotMetadataTestJSON-593672773 None] snapshot_file for this snap is: volume-0f361279-5c6a-45af-87b0-528e57c3d04b.7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5183587a-5b45-4063-8a6b-035459bab9a9]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-99c43724-88e8-4817-afe0-0f6408189092 tempest-SnapshotMetadataTestJSON-593672773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:29 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.info" returned: 0 in 0.486s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:29 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:07:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:29 devstack sudo[91683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.info Sep 25 17:07:29 devstack sudo[91683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:29 devstack sudo[91682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa Sep 25 17:07:29 devstack sudo[91682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:30 devstack sudo[91683]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.info" returned: 0 in 0.316s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.901s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] Creating offline snapshot e01d9c5d-e6c9-4d75-9659-e728e66dedff of volume d849495c-3631-4f37-9e7c-113a0fba4cf2 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:07:30 devstack sudo[91682]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-99c43724-88e8-4817-afe0-0f6408189092 tempest-SnapshotMetadataTestJSON-593672773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa" returned: 0 in 0.470s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-99c43724-88e8-4817-afe0-0f6408189092 tempest-SnapshotMetadataTestJSON-593672773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f361279-5c6a-45af-87b0-528e57c3d04b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:07:30 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[992cf07b-2658-4322-8f9b-5206aecdbfb8]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:30 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c149f5-1db8-4f41-a2f5-521b5aeb03a4]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-99c43724-88e8-4817-afe0-0f6408189092 tempest-SnapshotMetadataTestJSON-593672773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:30 devstack sudo[91692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2 Sep 25 17:07:30 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:30 devstack sudo[91693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b Sep 25 17:07:30 devstack sudo[91693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:30 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2" returned: 0 in 0.438s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.e01d9c5d-e6c9-4d75-9659-e728e66dedff 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:30 devstack sudo[91693]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-99c43724-88e8-4817-afe0-0f6408189092 tempest-SnapshotMetadataTestJSON-593672773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b" returned: 0 in 0.445s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-99c43724-88e8-4817-afe0-0f6408189092 tempest-SnapshotMetadataTestJSON-593672773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:30 devstack sudo[91703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.e01d9c5d-e6c9-4d75-9659-e728e66dedff 1G Sep 25 17:07:30 devstack sudo[91703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:30 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa Sep 25 17:07:30 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:31 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-99c43724-88e8-4817-afe0-0f6408189092 tempest-SnapshotMetadataTestJSON-593672773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa" returned: 0 in 0.470s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-99c43724-88e8-4817-afe0-0f6408189092 tempest-SnapshotMetadataTestJSON-593672773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:31 devstack sudo[91713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa Sep 25 17:07:31 devstack sudo[91713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:31 devstack sudo[91703]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.e01d9c5d-e6c9-4d75-9659-e728e66dedff 1G" returned: 0 in 0.632s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d849495c-3631-4f37-9e7c-113a0fba4cf2 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.e01d9c5d-e6c9-4d75-9659-e728e66dedff {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:31 devstack sudo[91716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d849495c-3631-4f37-9e7c-113a0fba4cf2 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.e01d9c5d-e6c9-4d75-9659-e728e66dedff Sep 25 17:07:31 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:31 devstack sudo[91713]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-99c43724-88e8-4817-afe0-0f6408189092 tempest-SnapshotMetadataTestJSON-593672773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b.7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa" returned: 0 in 0.311s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:31 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-99c43724-88e8-4817-afe0-0f6408189092 tempest-SnapshotMetadataTestJSON-593672773 None] Lock "cinder-quobyte-7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa" released by "_delete_snapshot" :: held 1.890s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:31 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-99c43724-88e8-4817-afe0-0f6408189092 tempest-SnapshotMetadataTestJSON-593672773 None] Lock "cinder-quobyte-0f361279-5c6a-45af-87b0-528e57c3d04b" released by "delete_snapshot" :: held 1.916s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:31 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-99c43724-88e8-4817-afe0-0f6408189092 tempest-SnapshotMetadataTestJSON-593672773 None] Created reservations ['41ab5815-ce3d-4624-9c46-c4faff9a8b97', 'f2d70431-514a-474e-9f6c-299929018801', '9bb7f454-a1b1-48df-85fb-c400f8b5ea84', '1402e6b3-e1fa-4799-ba48-91a455a20920'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:07:31 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d849495c-3631-4f37-9e7c-113a0fba4cf2 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.e01d9c5d-e6c9-4d75-9659-e728e66dedff" returned: 0 in 0.401s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:31 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.e01d9c5d-e6c9-4d75-9659-e728e66dedff is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:07:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.e01d9c5d-e6c9-4d75-9659-e728e66dedff {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:31 devstack sudo[91723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.e01d9c5d-e6c9-4d75-9659-e728e66dedff Sep 25 17:07:31 devstack sudo[91723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:31 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-99c43724-88e8-4817-afe0-0f6408189092 tempest-SnapshotMetadataTestJSON-593672773 None] Delete snapshot completed successfully. Sep 25 17:07:31 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-99c43724-88e8-4817-afe0-0f6408189092 tempest-SnapshotMetadataTestJSON-593672773 None] Lock "cinder-7f8983e3-90ee-42ef-9ac6-a3f98cb2bbfa-delete_snapshot" released by "delete_snapshot" :: held 2.148s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:31 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-03fe2a4a-716a-48ce-b68f-d45cd5ca6d91 tempest-SnapshotMetadataTestJSON-593672773 None] Acquiring lock "cinder-0f361279-5c6a-45af-87b0-528e57c3d04b-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:31 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-03fe2a4a-716a-48ce-b68f-d45cd5ca6d91 tempest-SnapshotMetadataTestJSON-593672773 None] Lock "cinder-0f361279-5c6a-45af-87b0-528e57c3d04b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-03fe2a4a-716a-48ce-b68f-d45cd5ca6d91 tempest-SnapshotMetadataTestJSON-593672773 None] Acquiring lock "cinder-quobyte-0f361279-5c6a-45af-87b0-528e57c3d04b" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:32 devstack sudo[91723]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.e01d9c5d-e6c9-4d75-9659-e728e66dedff" returned: 0 in 0.391s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-03fe2a4a-716a-48ce-b68f-d45cd5ca6d91 tempest-SnapshotMetadataTestJSON-593672773 None] Lock "cinder-quobyte-0f361279-5c6a-45af-87b0-528e57c3d04b" acquired by "delete_volume" :: waited 0.028s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:32 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cad3967-4ddd-4fb6-9337-4f29dac3a368]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-03fe2a4a-716a-48ce-b68f-d45cd5ca6d91 tempest-SnapshotMetadataTestJSON-593672773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:32 devstack sudo[91730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.info Sep 25 17:07:32 devstack sudo[91730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:32 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b Sep 25 17:07:32 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:32 devstack sudo[91730]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.info" returned: 0 in 0.398s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:32 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:07:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:32 devstack sudo[91736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.info Sep 25 17:07:32 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:32 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-03fe2a4a-716a-48ce-b68f-d45cd5ca6d91 tempest-SnapshotMetadataTestJSON-593672773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b" returned: 0 in 0.515s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-03fe2a4a-716a-48ce-b68f-d45cd5ca6d91 tempest-SnapshotMetadataTestJSON-593672773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:32 devstack sudo[91739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b Sep 25 17:07:32 devstack sudo[91739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:32 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.info" returned: 0 in 0.393s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.934s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:33 devstack sudo[91739]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:33 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-77097761-93a5-4b1a-86f0-b5b509e9a2c5 tempest-GroupSnapshotsTest-1623939309 None] group_snapshot 13fb371a-640d-4b16-8876-ad12869db173: created successfully Sep 25 17:07:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-03fe2a4a-716a-48ce-b68f-d45cd5ca6d91 tempest-SnapshotMetadataTestJSON-593672773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0f361279-5c6a-45af-87b0-528e57c3d04b" returned: 0 in 0.530s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-03fe2a4a-716a-48ce-b68f-d45cd5ca6d91 tempest-SnapshotMetadataTestJSON-593672773 None] Lock "cinder-quobyte-0f361279-5c6a-45af-87b0-528e57c3d04b" released by "delete_volume" :: held 1.206s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:33 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-03fe2a4a-716a-48ce-b68f-d45cd5ca6d91 tempest-SnapshotMetadataTestJSON-593672773 None] Created reservations ['0bf0bb65-f99c-42df-a1d7-0176108720e3', '853b9a96-55e4-44b2-981f-9315f5266ddf', 'f10d9082-23c8-49c4-b865-d78239de2cfc', 'f0c175ea-c1ea-44e4-a949-efaa0d956164'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:07:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-03fe2a4a-716a-48ce-b68f-d45cd5ca6d91 tempest-SnapshotMetadataTestJSON-593672773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-03fe2a4a-716a-48ce-b68f-d45cd5ca6d91 tempest-SnapshotMetadataTestJSON-593672773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-03fe2a4a-716a-48ce-b68f-d45cd5ca6d91 tempest-SnapshotMetadataTestJSON-593672773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:07:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-03fe2a4a-716a-48ce-b68f-d45cd5ca6d91 tempest-SnapshotMetadataTestJSON-593672773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:07:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-03fe2a4a-716a-48ce-b68f-d45cd5ca6d91 tempest-SnapshotMetadataTestJSON-593672773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-03fe2a4a-716a-48ce-b68f-d45cd5ca6d91 tempest-SnapshotMetadataTestJSON-593672773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:33 devstack sudo[91745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:07:33 devstack sudo[91745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:33 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] group_snapshot 13fb371a-640d-4b16-8876-ad12869db173: deleting Sep 25 17:07:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] group_snapshot 13fb371a-640d-4b16-8876-ad12869db173: deleting {{(pid=87211) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 17:07:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "cinder-quobyte-7386b2ff-e9ac-4717-a71f-56bb1826253e" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-7386b2ff-e9ac-4717-a71f-56bb1826253e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "cinder-quobyte-211462fb-ce10-47b1-a8ad-459598652a26" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-211462fb-ce10-47b1-a8ad-459598652a26" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Deleting offline snapshot 211462fb-ce10-47b1-a8ad-459598652a26 of volume 7386b2ff-e9ac-4717-a71f-56bb1826253e {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:07:33 devstack sudo[91745]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] snapshot_file for this snap is: volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.211462fb-ce10-47b1-a8ad-459598652a26 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:07:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-03fe2a4a-716a-48ce-b68f-d45cd5ca6d91 tempest-SnapshotMetadataTestJSON-593672773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.371s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:33 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-03fe2a4a-716a-48ce-b68f-d45cd5ca6d91 tempest-SnapshotMetadataTestJSON-593672773 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:07:33 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-03fe2a4a-716a-48ce-b68f-d45cd5ca6d91 tempest-SnapshotMetadataTestJSON-593672773 None] Deleted volume successfully. Sep 25 17:07:33 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c7b6a4-524f-419c-8428-4b8cf4eeda00]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.211462fb-ce10-47b1-a8ad-459598652a26 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-03fe2a4a-716a-48ce-b68f-d45cd5ca6d91 tempest-SnapshotMetadataTestJSON-593672773 None] Lock "cinder-0f361279-5c6a-45af-87b0-528e57c3d04b-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:34 devstack sudo[91748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.211462fb-ce10-47b1-a8ad-459598652a26 Sep 25 17:07:34 devstack sudo[91748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:34 devstack sudo[91748]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.211462fb-ce10-47b1-a8ad-459598652a26" returned: 0 in 0.593s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7386b2ff-e9ac-4717-a71f-56bb1826253e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:07:34 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa0cfcd-2c95-46b3-acc1-c3e1cabcba92]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:34 devstack sudo[91760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e Sep 25 17:07:34 devstack sudo[91760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-84e20d77-e42a-4c36-8764-cac236e28f06 req-ad5b9bc3-fcea-4c76-9613-caf331667b26 tempest-ServerActionsTestOtherA-902126569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-84e20d77-e42a-4c36-8764-cac236e28f06 req-ad5b9bc3-fcea-4c76-9613-caf331667b26 tempest-ServerActionsTestOtherA-902126569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-84e20d77-e42a-4c36-8764-cac236e28f06 req-ad5b9bc3-fcea-4c76-9613-caf331667b26 tempest-ServerActionsTestOtherA-902126569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-84e20d77-e42a-4c36-8764-cac236e28f06 req-ad5b9bc3-fcea-4c76-9613-caf331667b26 tempest-ServerActionsTestOtherA-902126569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-73576bfa-8140-4462-9241-7fa212287974', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e6d4c8d-63bb-44fa-8b69-9a5786ab80b1', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:07:35 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-84e20d77-e42a-4c36-8764-cac236e28f06 req-ad5b9bc3-fcea-4c76-9613-caf331667b26 tempest-ServerActionsTestOtherA-902126569 None] attachment_update completed successfully. Sep 25 17:07:35 devstack sudo[91760]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e" returned: 0 in 0.807s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.211462fb-ce10-47b1-a8ad-459598652a26 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:35 devstack sudo[91769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.211462fb-ce10-47b1-a8ad-459598652a26 Sep 25 17:07:35 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:35 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.211462fb-ce10-47b1-a8ad-459598652a26" returned: 0 in 0.556s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.211462fb-ce10-47b1-a8ad-459598652a26 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:35 devstack sudo[91775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.211462fb-ce10-47b1-a8ad-459598652a26 Sep 25 17:07:35 devstack sudo[91775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:36 devstack sudo[91775]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e.211462fb-ce10-47b1-a8ad-459598652a26" returned: 0 in 0.303s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-211462fb-ce10-47b1-a8ad-459598652a26" released by "_delete_snapshot" :: held 2.449s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-7386b2ff-e9ac-4717-a71f-56bb1826253e" released by "delete_snapshot" :: held 2.480s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "cinder-quobyte-d849495c-3631-4f37-9e7c-113a0fba4cf2" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-d849495c-3631-4f37-9e7c-113a0fba4cf2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "cinder-quobyte-e01d9c5d-e6c9-4d75-9659-e728e66dedff" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-e01d9c5d-e6c9-4d75-9659-e728e66dedff" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Deleting offline snapshot e01d9c5d-e6c9-4d75-9659-e728e66dedff of volume d849495c-3631-4f37-9e7c-113a0fba4cf2 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:07:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] snapshot_file for this snap is: volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.e01d9c5d-e6c9-4d75-9659-e728e66dedff {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:07:36 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1af280-4b2d-4b84-a704-4bd5208f62fd]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.e01d9c5d-e6c9-4d75-9659-e728e66dedff {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:36 devstack sudo[91779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.e01d9c5d-e6c9-4d75-9659-e728e66dedff Sep 25 17:07:36 devstack sudo[91779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:36 devstack sudo[91779]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.e01d9c5d-e6c9-4d75-9659-e728e66dedff" returned: 0 in 0.516s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d849495c-3631-4f37-9e7c-113a0fba4cf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:07:36 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbfdac5-1390-4a72-ab0a-28bb6dda0610]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:37 devstack sudo[91785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2 Sep 25 17:07:37 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:37 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2" returned: 0 in 0.436s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.e01d9c5d-e6c9-4d75-9659-e728e66dedff {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:37 devstack sudo[91791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.e01d9c5d-e6c9-4d75-9659-e728e66dedff Sep 25 17:07:37 devstack sudo[91791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:37 devstack sudo[91791]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.e01d9c5d-e6c9-4d75-9659-e728e66dedff" returned: 0 in 0.483s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.e01d9c5d-e6c9-4d75-9659-e728e66dedff {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:37 devstack sudo[91799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.e01d9c5d-e6c9-4d75-9659-e728e66dedff Sep 25 17:07:37 devstack sudo[91799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:38 devstack sudo[91799]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2.e01d9c5d-e6c9-4d75-9659-e728e66dedff" returned: 0 in 0.279s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-e01d9c5d-e6c9-4d75-9659-e728e66dedff" released by "_delete_snapshot" :: held 1.924s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-d849495c-3631-4f37-9e7c-113a0fba4cf2" released by "delete_snapshot" :: held 1.954s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:38 devstack cinder-volume[87211]: WARNING cinder.quota [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1790147434 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1790147434, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:07:38 devstack cinder-volume[87211]: WARNING cinder.quota [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1790147434 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1790147434, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:07:38 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Created reservations ['284b7be4-81df-47d4-844d-15a5983defa1', '7e56bba1-9b8c-4a02-93de-b65f4857cdfd', '5e49c862-fdf9-4f89-9d34-85db7d56081e', '0e949f57-bbc0-489d-8347-17a7ccb02079'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:07:38 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] Created reservations ['16502d00-55b6-44c1-b5e0-12911d21e056', 'ec724a36-4557-4c9b-9fdc-b68cf5878cde', '393e4f58-aa94-4767-b308-ad5db8099f3c', '4c1be1e4-dcce-473d-96b4-c8d1cf3d2edc'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:07:38 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-eab119e5-1d5f-489f-a7c1-e4faa7a7867f tempest-GroupSnapshotsTest-1623939309 None] group_snapshot 13fb371a-640d-4b16-8876-ad12869db173: deleted successfully Sep 25 17:07:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "cinder-quobyte-7386b2ff-e9ac-4717-a71f-56bb1826253e" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-7386b2ff-e9ac-4717-a71f-56bb1826253e" acquired by "delete_volume" :: waited 0.026s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:40 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a570ad-dbfb-44df-a695-f00c6a9b9f1b]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:40 devstack sudo[92249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e Sep 25 17:07:40 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:41 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e" returned: 0 in 0.617s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:41 devstack sudo[92264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e Sep 25 17:07:41 devstack sudo[92264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:41 devstack sudo[92264]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7386b2ff-e9ac-4717-a71f-56bb1826253e" returned: 0 in 0.434s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:41 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-7386b2ff-e9ac-4717-a71f-56bb1826253e" released by "delete_volume" :: held 1.191s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:41 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "cinder-quobyte-d849495c-3631-4f37-9e7c-113a0fba4cf2" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:41 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-d849495c-3631-4f37-9e7c-113a0fba4cf2" acquired by "delete_volume" :: waited 0.031s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:41 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[78851419-203d-4f8b-9dba-f8238130681d]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:41 devstack sudo[92281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2 Sep 25 17:07:41 devstack sudo[92281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:42 devstack sudo[92281]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2" returned: 0 in 0.548s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:42 devstack sudo[92286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2 Sep 25 17:07:42 devstack sudo[92286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:42 devstack sudo[92286]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d849495c-3631-4f37-9e7c-113a0fba4cf2" returned: 0 in 0.381s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-d849495c-3631-4f37-9e7c-113a0fba4cf2" released by "delete_volume" :: held 1.050s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:42 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] Created reservations ['1ee5dae5-969e-4bda-842f-c680d827e70e'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:07:42 devstack cinder-volume[87211]: WARNING cinder.quota [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1790147434 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1790147434, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:07:43 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] Created reservations ['7934012f-643a-4af9-9520-82e59463a1a3', '81fef6b7-b169-432b-a834-e5a1d7c937b0', 'e0721a95-2324-40ab-8029-575ac4b8900a', '302bbfa6-9f4a-48fe-aae7-2b8ba9223c74'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:07:43 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] Created reservations ['0ef01794-07f6-471a-bd38-e3a7312e1775', 'a0066904-e96b-4c05-a0d8-f75d7dc36833', '200448a7-78c4-4da5-9a7b-f87336970726', 'e6cca47a-30fd-4194-b0a3-a7798caa072f'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:07:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:07:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:07:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:43 devstack sudo[92293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:07:43 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:44 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.660s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:44 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:07:44 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-e039757c-a2e5-4791-bc19-ff46336d7515 tempest-GroupSnapshotsTest-1623939309 None] Delete group completed successfully. Sep 25 17:07:45 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-767281da-e307-481d-bc9c-d032a81e8069 tempest-GroupSnapshotsTest-1623939309 None] Group tempest-GroupSnapshotsTest-Group-1501715896: creating Sep 25 17:07:45 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-767281da-e307-481d-bc9c-d032a81e8069 tempest-GroupSnapshotsTest-1623939309 None] Group tempest-GroupSnapshotsTest-Group-1501715896: created successfully Sep 25 17:07:45 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-767281da-e307-481d-bc9c-d032a81e8069 tempest-GroupSnapshotsTest-1623939309 None] Create group completed successfully. Sep 25 17:07:47 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:07:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Flow 'volume_create_manager' (536b6b93-5822-4213-b470-c130ca4304b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:07:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7a9d2e-e373-458b-a165-bf2a03b0b697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7a9d2e-e373-458b-a165-bf2a03b0b697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-155879407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=68c3f4a4-83de-4429-aff3-7d5679a55731,host='devstack@QuobyteHD#QuobyteHD',id=ebb0b56f-aae1-45de-8543-2e56d27a6e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b588af0f4f46446da58a50cbd4f6a420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:48Z,use_quota=True,user_id='11edca724f1e44369423a6b59b027cbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f77745c-5ab5-464a-9b0b-3cc1dbfba876),volume_type_id=2f77745c-5ab5-464a-9b0b-3cc1dbfba876)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e1a874-fadc-4732-82ba-d7fb7256e726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e1a874-fadc-4732-82ba-d7fb7256e726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39bd90a3-af11-4c15-8428-0d83f9b0bd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39bd90a3-af11-4c15-8428-0d83f9b0bd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebb0b56f-aae1-45de-8543-2e56d27a6e23', 'volume_name': 'volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f0d05ac-c105-47d5-8bdf-e49c8f4547fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f0d05ac-c105-47d5-8bdf-e49c8f4547fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1708d7-35e8-4b68-ad2b-c456879eb373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:48 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Volume ebb0b56f-aae1-45de-8543-2e56d27a6e23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23', 'volume_size': 1} Sep 25 17:07:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=68c3f4a4-83de-4429-aff3-7d5679a55731,created_at=2026-09-25T15:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-155879407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=68c3f4a4-83de-4429-aff3-7d5679a55731,host='devstack@QuobyteHD#QuobyteHD',id=ebb0b56f-aae1-45de-8543-2e56d27a6e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b588af0f4f46446da58a50cbd4f6a420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:48Z,use_quota=True,user_id='11edca724f1e44369423a6b59b027cbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f77745c-5ab5-464a-9b0b-3cc1dbfba876),volume_type_id=2f77745c-5ab5-464a-9b0b-3cc1dbfba876)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:07:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Creating volume ebb0b56f-aae1-45de-8543-2e56d27a6e23 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:07:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:07:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:07:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:07:48 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:07:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:48 devstack sudo[92299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23 1073741824 Sep 25 17:07:48 devstack sudo[92299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:49 devstack sudo[92299]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23 1073741824" returned: 0 in 1.020s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:49 devstack sudo[92307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23 Sep 25 17:07:49 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:49 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23" returned: 0 in 0.694s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:07:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1708d7-35e8-4b68-ad2b-c456879eb373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0655cc9a-0aaf-44c8-b287-4e006a8ec19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:50 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Volume volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23 (ebb0b56f-aae1-45de-8543-2e56d27a6e23): created successfully Sep 25 17:07:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0655cc9a-0aaf-44c8-b287-4e006a8ec19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Flow 'volume_create_manager' (536b6b93-5822-4213-b470-c130ca4304b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:07:50 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-78c988cf-03c0-4744-9776-ecdfdd27bc1a tempest-GroupSnapshotsTest-1623939309 None] Created volume successfully. Sep 25 17:07:50 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-388c00c7-eeb0-47be-9d3c-c3e646f9c1c6 tempest-GroupSnapshotsTest-1623939309 None] GroupSnapshot cd976483-8046-4d9e-a5e0-d36ee3a40c77: creating. Sep 25 17:07:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-388c00c7-eeb0-47be-9d3c-c3e646f9c1c6 tempest-GroupSnapshotsTest-1623939309 None] Group snapshot cd976483-8046-4d9e-a5e0-d36ee3a40c77: creating. {{(pid=87211) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 17:07:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-388c00c7-eeb0-47be-9d3c-c3e646f9c1c6 tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-388c00c7-eeb0-47be-9d3c-c3e646f9c1c6 tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-388c00c7-eeb0-47be-9d3c-c3e646f9c1c6 tempest-GroupSnapshotsTest-1623939309 None] Creating offline snapshot c1e02468-360f-40cc-89ba-3796f1945f2a of volume ebb0b56f-aae1-45de-8543-2e56d27a6e23 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:07:51 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2881ae-74dc-4051-ba3b-00118b6199d7]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-388c00c7-eeb0-47be-9d3c-c3e646f9c1c6 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:51 devstack sudo[92314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23 Sep 25 17:07:51 devstack sudo[92314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:51 devstack sudo[92314]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-388c00c7-eeb0-47be-9d3c-c3e646f9c1c6 tempest-GroupSnapshotsTest-1623939309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23" returned: 0 in 0.532s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-388c00c7-eeb0-47be-9d3c-c3e646f9c1c6 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.c1e02468-360f-40cc-89ba-3796f1945f2a 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:51 devstack sudo[92319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.c1e02468-360f-40cc-89ba-3796f1945f2a 1G Sep 25 17:07:51 devstack sudo[92319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:52 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:07:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Flow 'volume_create_manager' (4821b791-5d39-408d-b8d5-a14dbf7a2623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:07:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cbbc76a-6c34-418f-a81d-95a2d036cd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cbbc76a-6c34-418f-a81d-95a2d036cd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-183025583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b457df-8d10-455e-88fd-39d46ea5b18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0171838215c4ae89af2435290688730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:52Z,use_quota=True,user_id='94135f060869408f84d35b11534e915b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ca81f0-208e-42f6-8ce6-a67e6404d21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ca81f0-208e-42f6-8ce6-a67e6404d21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6cec49-aa1a-41db-8d2f-560bb67acc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6cec49-aa1a-41db-8d2f-560bb67acc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17b457df-8d10-455e-88fd-39d46ea5b18c', 'volume_name': 'volume-17b457df-8d10-455e-88fd-39d46ea5b18c', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f477300c-c3c3-49d3-b495-0950e99af647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f477300c-c3c3-49d3-b495-0950e99af647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b11123a-9dc3-4ae2-bcb9-5e8dea8b20c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:52 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Volume 17b457df-8d10-455e-88fd-39d46ea5b18c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17b457df-8d10-455e-88fd-39d46ea5b18c', 'volume_size': 1} Sep 25 17:07:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:52 devstack sudo[92319]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-388c00c7-eeb0-47be-9d3c-c3e646f9c1c6 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.c1e02468-360f-40cc-89ba-3796f1945f2a 1G" returned: 0 in 0.825s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-388c00c7-eeb0-47be-9d3c-c3e646f9c1c6 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.c1e02468-360f-40cc-89ba-3796f1945f2a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:52 devstack sudo[92325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.c1e02468-360f-40cc-89ba-3796f1945f2a Sep 25 17:07:52 devstack sudo[92325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:53 devstack sudo[92325]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-388c00c7-eeb0-47be-9d3c-c3e646f9c1c6 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.c1e02468-360f-40cc-89ba-3796f1945f2a" returned: 0 in 0.684s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:53 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-388c00c7-eeb0-47be-9d3c-c3e646f9c1c6 tempest-GroupSnapshotsTest-1623939309 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.c1e02468-360f-40cc-89ba-3796f1945f2a is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:07:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-388c00c7-eeb0-47be-9d3c-c3e646f9c1c6 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.c1e02468-360f-40cc-89ba-3796f1945f2a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:53 devstack sudo[92331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.c1e02468-360f-40cc-89ba-3796f1945f2a Sep 25 17:07:53 devstack sudo[92331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:53 devstack sudo[92331]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-388c00c7-eeb0-47be-9d3c-c3e646f9c1c6 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.c1e02468-360f-40cc-89ba-3796f1945f2a" returned: 0 in 0.411s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-388c00c7-eeb0-47be-9d3c-c3e646f9c1c6 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:07:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:07:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:07:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:53 devstack sudo[92335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.info Sep 25 17:07:53 devstack sudo[92335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:53 devstack sudo[92337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:07:53 devstack sudo[92337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:54 devstack sudo[92335]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-388c00c7-eeb0-47be-9d3c-c3e646f9c1c6 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.info" returned: 0 in 0.455s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:54 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-388c00c7-eeb0-47be-9d3c-c3e646f9c1c6 tempest-GroupSnapshotsTest-1623939309 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:07:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-388c00c7-eeb0-47be-9d3c-c3e646f9c1c6 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:54 devstack sudo[92337]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.431s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:54 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:07:54 devstack sudo[92341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.info Sep 25 17:07:54 devstack sudo[92341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:54 devstack sudo[92341]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-388c00c7-eeb0-47be-9d3c-c3e646f9c1c6 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.info" returned: 0 in 0.581s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-388c00c7-eeb0-47be-9d3c-c3e646f9c1c6 tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.691s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.308s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-183025583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b457df-8d10-455e-88fd-39d46ea5b18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0171838215c4ae89af2435290688730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:52Z,use_quota=True,user_id='94135f060869408f84d35b11534e915b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:07:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Creating volume 17b457df-8d10-455e-88fd-39d46ea5b18c {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:07:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:07:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:07:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:07:54 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:07:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-17b457df-8d10-455e-88fd-39d46ea5b18c 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:54 devstack sudo[92344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-17b457df-8d10-455e-88fd-39d46ea5b18c 1073741824 Sep 25 17:07:54 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:54 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-388c00c7-eeb0-47be-9d3c-c3e646f9c1c6 tempest-GroupSnapshotsTest-1623939309 None] group_snapshot cd976483-8046-4d9e-a5e0-d36ee3a40c77: created successfully Sep 25 17:07:55 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-17b457df-8d10-455e-88fd-39d46ea5b18c 1073741824" returned: 0 in 1.151s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:55 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] group_snapshot cd976483-8046-4d9e-a5e0-d36ee3a40c77: deleting Sep 25 17:07:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-17b457df-8d10-455e-88fd-39d46ea5b18c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:56 devstack sudo[92351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-17b457df-8d10-455e-88fd-39d46ea5b18c Sep 25 17:07:56 devstack sudo[92351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] group_snapshot cd976483-8046-4d9e-a5e0-d36ee3a40c77: deleting {{(pid=87211) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 17:07:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "cinder-quobyte-ebb0b56f-aae1-45de-8543-2e56d27a6e23" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-ebb0b56f-aae1-45de-8543-2e56d27a6e23" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "cinder-quobyte-c1e02468-360f-40cc-89ba-3796f1945f2a" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-c1e02468-360f-40cc-89ba-3796f1945f2a" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] Deleting offline snapshot c1e02468-360f-40cc-89ba-3796f1945f2a of volume ebb0b56f-aae1-45de-8543-2e56d27a6e23 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:07:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] snapshot_file for this snap is: volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.c1e02468-360f-40cc-89ba-3796f1945f2a {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:07:56 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ad882a-0785-4ffb-834d-757e033d8893]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.c1e02468-360f-40cc-89ba-3796f1945f2a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:56 devstack sudo[92354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.c1e02468-360f-40cc-89ba-3796f1945f2a Sep 25 17:07:56 devstack sudo[92354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:56 devstack sudo[92351]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-17b457df-8d10-455e-88fd-39d46ea5b18c" returned: 0 in 0.566s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:07:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b11123a-9dc3-4ae2-bcb9-5e8dea8b20c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17b457df-8d10-455e-88fd-39d46ea5b18c', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4021f88e-9d2e-4fb7-9bcb-461e95bba44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:56 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Volume volume-17b457df-8d10-455e-88fd-39d46ea5b18c (17b457df-8d10-455e-88fd-39d46ea5b18c): created successfully Sep 25 17:07:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4021f88e-9d2e-4fb7-9bcb-461e95bba44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Flow 'volume_create_manager' (4821b791-5d39-408d-b8d5-a14dbf7a2623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:07:56 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-d7709bfe-ee5a-4281-b98e-142e33e9be16 tempest-VolumesTransfersV355Test-119147960 None] Created volume successfully. Sep 25 17:07:56 devstack sudo[92354]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.c1e02468-360f-40cc-89ba-3796f1945f2a" returned: 0 in 0.465s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:07:56 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[456c4e11-0d65-460a-b357-82a9a5f2e03e]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:56 devstack sudo[92361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23 Sep 25 17:07:56 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:57 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23" returned: 0 in 0.542s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.c1e02468-360f-40cc-89ba-3796f1945f2a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:57 devstack sudo[92367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.c1e02468-360f-40cc-89ba-3796f1945f2a Sep 25 17:07:57 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:57 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.c1e02468-360f-40cc-89ba-3796f1945f2a" returned: 0 in 0.468s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.c1e02468-360f-40cc-89ba-3796f1945f2a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:57 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.c1e02468-360f-40cc-89ba-3796f1945f2a Sep 25 17:07:57 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:58 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23.c1e02468-360f-40cc-89ba-3796f1945f2a" returned: 0 in 0.334s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-c1e02468-360f-40cc-89ba-3796f1945f2a" released by "_delete_snapshot" :: held 2.061s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-ebb0b56f-aae1-45de-8543-2e56d27a6e23" released by "delete_snapshot" :: held 2.128s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:58 devstack cinder-volume[87211]: WARNING cinder.quota [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1721182595 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1721182595, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:07:58 devstack cinder-volume[87211]: WARNING cinder.quota [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1721182595 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1721182595, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:07:58 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] Created reservations ['3af96e64-5733-4ae5-b154-43cdb0588e9c', 'b12ec512-c66e-4798-87dd-30248e6e6879', '52abf878-4f13-48e2-b8d3-2027d0ab5889', '687ca8a8-293c-4f5e-a79b-6936201a2db9'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:07:58 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-43296f53-80b1-4ab7-bd89-98e52d661b8f tempest-GroupSnapshotsTest-1623939309 None] group_snapshot cd976483-8046-4d9e-a5e0-d36ee3a40c77: deleted successfully Sep 25 17:07:59 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-af59bc4a-4c8e-4710-9d59-19ebf856d45a tempest-VolumesTransfersV355Test-2036068186 None] Transfer volume completed successfully. Sep 25 17:08:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7bfca910-d9d7-40ee-a834-ee3e039eca29 tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "cinder-quobyte-ebb0b56f-aae1-45de-8543-2e56d27a6e23" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7bfca910-d9d7-40ee-a834-ee3e039eca29 tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-ebb0b56f-aae1-45de-8543-2e56d27a6e23" acquired by "delete_volume" :: waited 0.046s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:00 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f10e64-4123-4f64-8281-bff16e427e17]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:08:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7bfca910-d9d7-40ee-a834-ee3e039eca29 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:00 devstack sudo[92421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23 Sep 25 17:08:00 devstack sudo[92421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:01 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-ccdc4231-75ad-4e4b-9795-b03a51427367 req-af73f217-12f5-41de-a608-69cac5e7aef3 tempest-ServerActionsTestOtherA-902126569 None] Terminate volume connection completed successfully. Sep 25 17:08:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-ccdc4231-75ad-4e4b-9795-b03a51427367 req-af73f217-12f5-41de-a608-69cac5e7aef3 tempest-ServerActionsTestOtherA-902126569 None] Deleting attachment 9e6d4c8d-63bb-44fa-8b69-9a5786ab80b1. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:08:01 devstack sudo[92421]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7bfca910-d9d7-40ee-a834-ee3e039eca29 tempest-GroupSnapshotsTest-1623939309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23" returned: 0 in 0.780s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7bfca910-d9d7-40ee-a834-ee3e039eca29 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:01 devstack sudo[92442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23 Sep 25 17:08:01 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b904af3f-9e32-4776-b9b2-27392b5e3145 tempest-VolumesTransfersV355Test-227271286 None] Acquiring lock "cinder-17b457df-8d10-455e-88fd-39d46ea5b18c-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b904af3f-9e32-4776-b9b2-27392b5e3145 tempest-VolumesTransfersV355Test-227271286 None] Lock "cinder-17b457df-8d10-455e-88fd-39d46ea5b18c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b904af3f-9e32-4776-b9b2-27392b5e3145 tempest-VolumesTransfersV355Test-227271286 None] Acquiring lock "cinder-quobyte-17b457df-8d10-455e-88fd-39d46ea5b18c" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b904af3f-9e32-4776-b9b2-27392b5e3145 tempest-VolumesTransfersV355Test-227271286 None] Lock "cinder-quobyte-17b457df-8d10-455e-88fd-39d46ea5b18c" acquired by "delete_volume" :: waited 0.036s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:01 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f152c932-e977-4b09-ad9e-138901c69477]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:08:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b904af3f-9e32-4776-b9b2-27392b5e3145 tempest-VolumesTransfersV355Test-227271286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-17b457df-8d10-455e-88fd-39d46ea5b18c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:01 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7bfca910-d9d7-40ee-a834-ee3e039eca29 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ebb0b56f-aae1-45de-8543-2e56d27a6e23" returned: 0 in 0.563s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7bfca910-d9d7-40ee-a834-ee3e039eca29 tempest-GroupSnapshotsTest-1623939309 None] Lock "cinder-quobyte-ebb0b56f-aae1-45de-8543-2e56d27a6e23" released by "delete_volume" :: held 1.520s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:01 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-17b457df-8d10-455e-88fd-39d46ea5b18c Sep 25 17:08:01 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:02 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-7bfca910-d9d7-40ee-a834-ee3e039eca29 tempest-GroupSnapshotsTest-1623939309 None] Created reservations ['98375896-ef5c-4d3c-a4dd-0da20a019c9b'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:08:02 devstack cinder-volume[87211]: WARNING cinder.quota [None req-7bfca910-d9d7-40ee-a834-ee3e039eca29 tempest-GroupSnapshotsTest-1623939309 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1721182595 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1721182595, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:08:02 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-7bfca910-d9d7-40ee-a834-ee3e039eca29 tempest-GroupSnapshotsTest-1623939309 None] Created reservations ['73105717-cbc8-4291-86a3-4518de353d6a', '9bb96446-2c16-4ef1-9fd4-6419a5a82667', '58a7b252-2f09-4f29-9874-f85129be0136', 'cc1ce13d-4286-4ee6-aead-cd4387cb02d9'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:08:02 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b904af3f-9e32-4776-b9b2-27392b5e3145 tempest-VolumesTransfersV355Test-227271286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-17b457df-8d10-455e-88fd-39d46ea5b18c" returned: 0 in 0.980s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b904af3f-9e32-4776-b9b2-27392b5e3145 tempest-VolumesTransfersV355Test-227271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-17b457df-8d10-455e-88fd-39d46ea5b18c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7bfca910-d9d7-40ee-a834-ee3e039eca29 tempest-GroupSnapshotsTest-1623939309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7bfca910-d9d7-40ee-a834-ee3e039eca29 tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7bfca910-d9d7-40ee-a834-ee3e039eca29 tempest-GroupSnapshotsTest-1623939309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7bfca910-d9d7-40ee-a834-ee3e039eca29 tempest-GroupSnapshotsTest-1623939309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7bfca910-d9d7-40ee-a834-ee3e039eca29 tempest-GroupSnapshotsTest-1623939309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7bfca910-d9d7-40ee-a834-ee3e039eca29 tempest-GroupSnapshotsTest-1623939309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:02 devstack sudo[92464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-17b457df-8d10-455e-88fd-39d46ea5b18c Sep 25 17:08:02 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:02 devstack sudo[92466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:08:02 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:03 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b904af3f-9e32-4776-b9b2-27392b5e3145 tempest-VolumesTransfersV355Test-227271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-17b457df-8d10-455e-88fd-39d46ea5b18c" returned: 0 in 0.489s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b904af3f-9e32-4776-b9b2-27392b5e3145 tempest-VolumesTransfersV355Test-227271286 None] Lock "cinder-quobyte-17b457df-8d10-455e-88fd-39d46ea5b18c" released by "delete_volume" :: held 1.583s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:03 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7bfca910-d9d7-40ee-a834-ee3e039eca29 tempest-GroupSnapshotsTest-1623939309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.501s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:03 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-7bfca910-d9d7-40ee-a834-ee3e039eca29 tempest-GroupSnapshotsTest-1623939309 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:08:03 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-7bfca910-d9d7-40ee-a834-ee3e039eca29 tempest-GroupSnapshotsTest-1623939309 None] Delete group completed successfully. Sep 25 17:08:03 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-b904af3f-9e32-4776-b9b2-27392b5e3145 tempest-VolumesTransfersV355Test-227271286 None] Created reservations ['3dd2da5f-04c1-4733-9c6f-588cebe81d33', '85cfdf85-91b0-43df-819c-7ab221afc749', '50ccef2f-9709-4688-93ec-718b9675bc64', 'bdaa3d1e-91b4-4d66-8a2d-806365e11c2a'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:08:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b904af3f-9e32-4776-b9b2-27392b5e3145 tempest-VolumesTransfersV355Test-227271286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b904af3f-9e32-4776-b9b2-27392b5e3145 tempest-VolumesTransfersV355Test-227271286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b904af3f-9e32-4776-b9b2-27392b5e3145 tempest-VolumesTransfersV355Test-227271286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b904af3f-9e32-4776-b9b2-27392b5e3145 tempest-VolumesTransfersV355Test-227271286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b904af3f-9e32-4776-b9b2-27392b5e3145 tempest-VolumesTransfersV355Test-227271286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b904af3f-9e32-4776-b9b2-27392b5e3145 tempest-VolumesTransfersV355Test-227271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:03 devstack sudo[92477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:08:03 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:03 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b904af3f-9e32-4776-b9b2-27392b5e3145 tempest-VolumesTransfersV355Test-227271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.585s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:03 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-b904af3f-9e32-4776-b9b2-27392b5e3145 tempest-VolumesTransfersV355Test-227271286 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:08:04 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b904af3f-9e32-4776-b9b2-27392b5e3145 tempest-VolumesTransfersV355Test-227271286 None] Deleted volume successfully. Sep 25 17:08:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b904af3f-9e32-4776-b9b2-27392b5e3145 tempest-VolumesTransfersV355Test-227271286 None] Lock "cinder-17b457df-8d10-455e-88fd-39d46ea5b18c-delete_volume" released by "delete_volume" :: held 2.707s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:04 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:08:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Flow 'volume_create_manager' (cc8587b0-ead3-48ae-8389-5df250b57921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:08:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca8af865-31ca-4413-a3b9-ab07de5208bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca8af865-31ca-4413-a3b9-ab07de5208bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1747184748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac8ee7f6-420f-4722-95fb-9a00fd62102f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0171838215c4ae89af2435290688730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:05Z,use_quota=True,user_id='94135f060869408f84d35b11534e915b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb04e5cf-6fd4-4bfe-b837-403d5b6673ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb04e5cf-6fd4-4bfe-b837-403d5b6673ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a3d258-87c1-4c15-adc2-401daf5ba50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a3d258-87c1-4c15-adc2-401daf5ba50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac8ee7f6-420f-4722-95fb-9a00fd62102f', 'volume_name': 'volume-ac8ee7f6-420f-4722-95fb-9a00fd62102f', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16015ea-d511-4cb3-8726-5d082751fe52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16015ea-d511-4cb3-8726-5d082751fe52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb58d8f4-7df1-41cd-990d-f4b9574dd656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:05 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Volume ac8ee7f6-420f-4722-95fb-9a00fd62102f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac8ee7f6-420f-4722-95fb-9a00fd62102f', 'volume_size': 1} Sep 25 17:08:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1747184748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac8ee7f6-420f-4722-95fb-9a00fd62102f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0171838215c4ae89af2435290688730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:05Z,use_quota=True,user_id='94135f060869408f84d35b11534e915b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:08:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Creating volume ac8ee7f6-420f-4722-95fb-9a00fd62102f {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:08:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:08:05 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:08:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac8ee7f6-420f-4722-95fb-9a00fd62102f 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:05 devstack sudo[92507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac8ee7f6-420f-4722-95fb-9a00fd62102f 1073741824 Sep 25 17:08:05 devstack sudo[92507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:05 devstack sudo[92507]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac8ee7f6-420f-4722-95fb-9a00fd62102f 1073741824" returned: 0 in 0.781s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac8ee7f6-420f-4722-95fb-9a00fd62102f {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:05 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac8ee7f6-420f-4722-95fb-9a00fd62102f Sep 25 17:08:05 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:06 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac8ee7f6-420f-4722-95fb-9a00fd62102f" returned: 0 in 0.405s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:08:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb58d8f4-7df1-41cd-990d-f4b9574dd656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac8ee7f6-420f-4722-95fb-9a00fd62102f', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d53ae17-9807-4219-b754-d8bc0969ccce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:06 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Volume volume-ac8ee7f6-420f-4722-95fb-9a00fd62102f (ac8ee7f6-420f-4722-95fb-9a00fd62102f): created successfully Sep 25 17:08:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d53ae17-9807-4219-b754-d8bc0969ccce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Flow 'volume_create_manager' (cc8587b0-ead3-48ae-8389-5df250b57921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:08:06 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-12bb002e-a3ca-41ef-8843-f302a0310f74 tempest-VolumesTransfersV355Test-119147960 None] Created volume successfully. Sep 25 17:08:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2c6c90ec-d796-4080-9fdd-58bfe46d75b8 tempest-VolumesTransfersV355Test-227271286 None] Acquiring lock "cinder-ac8ee7f6-420f-4722-95fb-9a00fd62102f-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2c6c90ec-d796-4080-9fdd-58bfe46d75b8 tempest-VolumesTransfersV355Test-227271286 None] Lock "cinder-ac8ee7f6-420f-4722-95fb-9a00fd62102f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2c6c90ec-d796-4080-9fdd-58bfe46d75b8 tempest-VolumesTransfersV355Test-227271286 None] Acquiring lock "cinder-quobyte-ac8ee7f6-420f-4722-95fb-9a00fd62102f" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2c6c90ec-d796-4080-9fdd-58bfe46d75b8 tempest-VolumesTransfersV355Test-227271286 None] Lock "cinder-quobyte-ac8ee7f6-420f-4722-95fb-9a00fd62102f" acquired by "delete_volume" :: waited 0.025s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:07 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c999cc-7fad-46c5-b9d1-6c0790dfc76b]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:08:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2c6c90ec-d796-4080-9fdd-58bfe46d75b8 tempest-VolumesTransfersV355Test-227271286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac8ee7f6-420f-4722-95fb-9a00fd62102f {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:07 devstack sudo[92521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac8ee7f6-420f-4722-95fb-9a00fd62102f Sep 25 17:08:07 devstack sudo[92521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:07 devstack sudo[92521]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2c6c90ec-d796-4080-9fdd-58bfe46d75b8 tempest-VolumesTransfersV355Test-227271286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac8ee7f6-420f-4722-95fb-9a00fd62102f" returned: 0 in 0.472s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2c6c90ec-d796-4080-9fdd-58bfe46d75b8 tempest-VolumesTransfersV355Test-227271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac8ee7f6-420f-4722-95fb-9a00fd62102f {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:07 devstack sudo[92530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac8ee7f6-420f-4722-95fb-9a00fd62102f Sep 25 17:08:07 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-ccdc4231-75ad-4e4b-9795-b03a51427367 req-53d8b0fd-53ba-4d2f-b30a-0cc4d4891448 tempest-ServerActionsTestOtherA-902126569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-ccdc4231-75ad-4e4b-9795-b03a51427367 req-53d8b0fd-53ba-4d2f-b30a-0cc4d4891448 tempest-ServerActionsTestOtherA-902126569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-ccdc4231-75ad-4e4b-9795-b03a51427367 req-53d8b0fd-53ba-4d2f-b30a-0cc4d4891448 tempest-ServerActionsTestOtherA-902126569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-ccdc4231-75ad-4e4b-9795-b03a51427367 req-53d8b0fd-53ba-4d2f-b30a-0cc4d4891448 tempest-ServerActionsTestOtherA-902126569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-73576bfa-8140-4462-9241-7fa212287974', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98b01ee7-1b29-4759-bc5c-1bc6cf5e4da0', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:08:08 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:08 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-ccdc4231-75ad-4e4b-9795-b03a51427367 req-53d8b0fd-53ba-4d2f-b30a-0cc4d4891448 tempest-ServerActionsTestOtherA-902126569 None] attachment_update completed successfully. Sep 25 17:08:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2c6c90ec-d796-4080-9fdd-58bfe46d75b8 tempest-VolumesTransfersV355Test-227271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac8ee7f6-420f-4722-95fb-9a00fd62102f" returned: 0 in 0.652s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2c6c90ec-d796-4080-9fdd-58bfe46d75b8 tempest-VolumesTransfersV355Test-227271286 None] Lock "cinder-quobyte-ac8ee7f6-420f-4722-95fb-9a00fd62102f" released by "delete_volume" :: held 1.208s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:08 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-2c6c90ec-d796-4080-9fdd-58bfe46d75b8 tempest-VolumesTransfersV355Test-227271286 None] Created reservations ['a95ba75f-69ca-4689-8262-3aef124d060c', 'e2dbeb74-9c74-4475-9b4a-2c0eccb82280', '31ac93c2-c76a-4edd-889e-14c0e0593e80', '0d5709db-f784-437e-aa3d-9a045b25ed9b'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:08:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2c6c90ec-d796-4080-9fdd-58bfe46d75b8 tempest-VolumesTransfersV355Test-227271286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2c6c90ec-d796-4080-9fdd-58bfe46d75b8 tempest-VolumesTransfersV355Test-227271286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-2c6c90ec-d796-4080-9fdd-58bfe46d75b8 tempest-VolumesTransfersV355Test-227271286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-2c6c90ec-d796-4080-9fdd-58bfe46d75b8 tempest-VolumesTransfersV355Test-227271286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2c6c90ec-d796-4080-9fdd-58bfe46d75b8 tempest-VolumesTransfersV355Test-227271286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2c6c90ec-d796-4080-9fdd-58bfe46d75b8 tempest-VolumesTransfersV355Test-227271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:08 devstack sudo[92567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:08:08 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:09 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2c6c90ec-d796-4080-9fdd-58bfe46d75b8 tempest-VolumesTransfersV355Test-227271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.477s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:09 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-2c6c90ec-d796-4080-9fdd-58bfe46d75b8 tempest-VolumesTransfersV355Test-227271286 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:08:09 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-2c6c90ec-d796-4080-9fdd-58bfe46d75b8 tempest-VolumesTransfersV355Test-227271286 None] Deleted volume successfully. Sep 25 17:08:09 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=139,cinder:UPDATE=140,cinder:INSERT=45,cinder:DELETE=7 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:08:09 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2c6c90ec-d796-4080-9fdd-58bfe46d75b8 tempest-VolumesTransfersV355Test-227271286 None] Lock "cinder-ac8ee7f6-420f-4722-95fb-9a00fd62102f-delete_volume" released by "delete_volume" :: held 2.048s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:18 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=138,cinder:INSERT=30,cinder:UPDATE=126,cinder:DELETE=5 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:08:30 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:08:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Flow 'volume_create_manager' (114fa12b-d29b-4ace-b74a-8b784601ed42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:08:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a902ade-7e12-4f39-b59a-c769c81b6309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a902ade-7e12-4f39-b59a-c769c81b6309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-841663037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08f4299-9111-487d-8eec-8d8b9d6c74c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3927f69661ed46aaa60ea77f71604f69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:31Z,use_quota=True,user_id='0caebfe8ae624683b057cd40b38f2945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c64ab3-9f6f-47f2-b93e-99c012881e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c64ab3-9f6f-47f2-b93e-99c012881e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2357c2b-59b5-4bc4-8a91-c0ce5cd44253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2357c2b-59b5-4bc4-8a91-c0ce5cd44253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd08f4299-9111-487d-8eec-8d8b9d6c74c8', 'volume_name': 'volume-d08f4299-9111-487d-8eec-8d8b9d6c74c8', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173a9c8e-03aa-49ca-afa2-0bf5ad1ae8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173a9c8e-03aa-49ca-afa2-0bf5ad1ae8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de2ff85-1876-4723-9534-8d6eb3cd2871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:30 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Volume d08f4299-9111-487d-8eec-8d8b9d6c74c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d08f4299-9111-487d-8eec-8d8b9d6c74c8', 'volume_size': 1} Sep 25 17:08:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-841663037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08f4299-9111-487d-8eec-8d8b9d6c74c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3927f69661ed46aaa60ea77f71604f69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:31Z,use_quota=True,user_id='0caebfe8ae624683b057cd40b38f2945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:08:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Creating volume d08f4299-9111-487d-8eec-8d8b9d6c74c8 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:08:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:08:30 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:08:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d08f4299-9111-487d-8eec-8d8b9d6c74c8 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:31 devstack sudo[93267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d08f4299-9111-487d-8eec-8d8b9d6c74c8 1073741824 Sep 25 17:08:31 devstack sudo[93267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:31 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:08:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Flow 'volume_create_manager' (99240f8f-e3ce-4ddb-8869-8ab4bee86efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:08:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c945f96-5dc6-4ac6-8073-c46c60de2c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c945f96-5dc6-4ac6-8073-c46c60de2c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-244843773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a05a4a-813a-41a1-bdee-a4c9a76937dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f0981a4c7b64ffe88cfb9b40e3bace5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:31Z,use_quota=True,user_id='bc5de84cda974c4c923899f3d5f8e191',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e70e3f27-c680-40cc-9387-a4f1f5429eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e70e3f27-c680-40cc-9387-a4f1f5429eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe411fd6-0bc1-4ef6-85b8-7e4beb9bd3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe411fd6-0bc1-4ef6-85b8-7e4beb9bd3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a05a4a-813a-41a1-bdee-a4c9a76937dc', 'volume_name': 'volume-b7a05a4a-813a-41a1-bdee-a4c9a76937dc', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ee5bcd-b517-4d80-8884-c9eec91bb6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ee5bcd-b517-4d80-8884-c9eec91bb6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f0ec57-3910-4d49-9e21-877cee1e69ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:31 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Volume b7a05a4a-813a-41a1-bdee-a4c9a76937dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a05a4a-813a-41a1-bdee-a4c9a76937dc', 'volume_size': 1} Sep 25 17:08:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:32 devstack sudo[93267]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d08f4299-9111-487d-8eec-8d8b9d6c74c8 1073741824" returned: 0 in 1.086s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d08f4299-9111-487d-8eec-8d8b9d6c74c8 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:32 devstack sudo[93272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d08f4299-9111-487d-8eec-8d8b9d6c74c8 Sep 25 17:08:32 devstack sudo[93272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:32 devstack sudo[93272]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d08f4299-9111-487d-8eec-8d8b9d6c74c8" returned: 0 in 0.450s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:08:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.248s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-244843773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a05a4a-813a-41a1-bdee-a4c9a76937dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f0981a4c7b64ffe88cfb9b40e3bace5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:31Z,use_quota=True,user_id='bc5de84cda974c4c923899f3d5f8e191',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:08:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Creating volume b7a05a4a-813a-41a1-bdee-a4c9a76937dc {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:08:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:08:32 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:08:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b7a05a4a-813a-41a1-bdee-a4c9a76937dc 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:32 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b7a05a4a-813a-41a1-bdee-a4c9a76937dc 1073741824 Sep 25 17:08:32 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de2ff85-1876-4723-9534-8d6eb3cd2871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d08f4299-9111-487d-8eec-8d8b9d6c74c8', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d3597c-381f-48b9-99f7-fcc3fa5afd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:32 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Volume volume-d08f4299-9111-487d-8eec-8d8b9d6c74c8 (d08f4299-9111-487d-8eec-8d8b9d6c74c8): created successfully Sep 25 17:08:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d3597c-381f-48b9-99f7-fcc3fa5afd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Flow 'volume_create_manager' (114fa12b-d29b-4ace-b74a-8b784601ed42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:08:32 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-5b7cc494-18e5-43d0-a9ff-ac2153b9f49f tempest-VolumesTransfersV357Test-272977953 None] Created volume successfully. Sep 25 17:08:33 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b7a05a4a-813a-41a1-bdee-a4c9a76937dc 1073741824" returned: 0 in 0.856s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b7a05a4a-813a-41a1-bdee-a4c9a76937dc {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:33 devstack sudo[93307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b7a05a4a-813a-41a1-bdee-a4c9a76937dc Sep 25 17:08:33 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:34 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b7a05a4a-813a-41a1-bdee-a4c9a76937dc" returned: 0 in 0.490s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:08:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:34 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f0ec57-3910-4d49-9e21-877cee1e69ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a05a4a-813a-41a1-bdee-a4c9a76937dc', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:34 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67bf9bdf-333b-48dc-8751-7faa4611d3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:34 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Volume volume-b7a05a4a-813a-41a1-bdee-a4c9a76937dc (b7a05a4a-813a-41a1-bdee-a4c9a76937dc): created successfully Sep 25 17:08:34 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67bf9bdf-333b-48dc-8751-7faa4611d3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:34 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Flow 'volume_create_manager' (99240f8f-e3ce-4ddb-8869-8ab4bee86efc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:08:34 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-0bf5dfcb-85db-4cea-9e3d-9b9b091f4df8 tempest-ServerRescueNegativeTestJSON-134655046 None] Created volume successfully. Sep 25 17:08:35 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b7537644-2dae-44a2-a8da-addbafe96156 tempest-VolumesTransfersV357Test-1538985761 None] Transfer volume completed successfully. Sep 25 17:08:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1812316d-3eb6-469a-bdf9-04934704ead8 tempest-VolumesTransfersV357Test-1024173056 None] Acquiring lock "cinder-d08f4299-9111-487d-8eec-8d8b9d6c74c8-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1812316d-3eb6-469a-bdf9-04934704ead8 tempest-VolumesTransfersV357Test-1024173056 None] Lock "cinder-d08f4299-9111-487d-8eec-8d8b9d6c74c8-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1812316d-3eb6-469a-bdf9-04934704ead8 tempest-VolumesTransfersV357Test-1024173056 None] Acquiring lock "cinder-quobyte-d08f4299-9111-487d-8eec-8d8b9d6c74c8" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1812316d-3eb6-469a-bdf9-04934704ead8 tempest-VolumesTransfersV357Test-1024173056 None] Lock "cinder-quobyte-d08f4299-9111-487d-8eec-8d8b9d6c74c8" acquired by "delete_volume" :: waited 0.023s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:37 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[3085417b-289f-450a-ae65-21792601d56a]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:08:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1812316d-3eb6-469a-bdf9-04934704ead8 tempest-VolumesTransfersV357Test-1024173056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d08f4299-9111-487d-8eec-8d8b9d6c74c8 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:37 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d08f4299-9111-487d-8eec-8d8b9d6c74c8 Sep 25 17:08:37 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:38 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1812316d-3eb6-469a-bdf9-04934704ead8 tempest-VolumesTransfersV357Test-1024173056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d08f4299-9111-487d-8eec-8d8b9d6c74c8" returned: 0 in 0.794s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1812316d-3eb6-469a-bdf9-04934704ead8 tempest-VolumesTransfersV357Test-1024173056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d08f4299-9111-487d-8eec-8d8b9d6c74c8 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:38 devstack sudo[93325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d08f4299-9111-487d-8eec-8d8b9d6c74c8 Sep 25 17:08:38 devstack sudo[93325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:38 devstack sudo[93325]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1812316d-3eb6-469a-bdf9-04934704ead8 tempest-VolumesTransfersV357Test-1024173056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d08f4299-9111-487d-8eec-8d8b9d6c74c8" returned: 0 in 0.410s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1812316d-3eb6-469a-bdf9-04934704ead8 tempest-VolumesTransfersV357Test-1024173056 None] Lock "cinder-quobyte-d08f4299-9111-487d-8eec-8d8b9d6c74c8" released by "delete_volume" :: held 1.285s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:38 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-1812316d-3eb6-469a-bdf9-04934704ead8 tempest-VolumesTransfersV357Test-1024173056 None] Created reservations ['af8478ee-6b19-4b04-9f75-b30d7fdc0e15', '833ee4b0-c7db-4871-8973-a6b51a62a9d4', '4e8d655a-7b8b-4948-883c-8356107ff0ee', '73abe15d-8904-4824-b44c-ff2a76bb8214'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:08:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1812316d-3eb6-469a-bdf9-04934704ead8 tempest-VolumesTransfersV357Test-1024173056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1812316d-3eb6-469a-bdf9-04934704ead8 tempest-VolumesTransfersV357Test-1024173056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1812316d-3eb6-469a-bdf9-04934704ead8 tempest-VolumesTransfersV357Test-1024173056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1812316d-3eb6-469a-bdf9-04934704ead8 tempest-VolumesTransfersV357Test-1024173056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1812316d-3eb6-469a-bdf9-04934704ead8 tempest-VolumesTransfersV357Test-1024173056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1812316d-3eb6-469a-bdf9-04934704ead8 tempest-VolumesTransfersV357Test-1024173056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:38 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:08:38 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:39 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1812316d-3eb6-469a-bdf9-04934704ead8 tempest-VolumesTransfersV357Test-1024173056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.565s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:39 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-1812316d-3eb6-469a-bdf9-04934704ead8 tempest-VolumesTransfersV357Test-1024173056 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:08:39 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-1812316d-3eb6-469a-bdf9-04934704ead8 tempest-VolumesTransfersV357Test-1024173056 None] Deleted volume successfully. Sep 25 17:08:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1812316d-3eb6-469a-bdf9-04934704ead8 tempest-VolumesTransfersV357Test-1024173056 None] Lock "cinder-d08f4299-9111-487d-8eec-8d8b9d6c74c8-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:40 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:08:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Flow 'volume_create_manager' (0f1eb3df-7484-481a-88c4-0500a7794c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:08:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9e9e63a-ad70-4bd3-ab17-c9e5f2dbc22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9e9e63a-ad70-4bd3-ab17-c9e5f2dbc22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1771768878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3927f69661ed46aaa60ea77f71604f69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:41Z,use_quota=True,user_id='0caebfe8ae624683b057cd40b38f2945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd9476a-e293-4e31-a6ee-5e5529a50d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd9476a-e293-4e31-a6ee-5e5529a50d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9023f9f9-c973-43de-ad09-718ad39e3849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9023f9f9-c973-43de-ad09-718ad39e3849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c', 'volume_name': 'volume-bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (828331de-0756-4afc-95e1-83ba8f178af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (828331de-0756-4afc-95e1-83ba8f178af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798b1ac2-8c0e-46d9-8232-2856d87e830d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:40 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Volume bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c', 'volume_size': 1} Sep 25 17:08:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1771768878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3927f69661ed46aaa60ea77f71604f69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:41Z,use_quota=True,user_id='0caebfe8ae624683b057cd40b38f2945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:08:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Creating volume bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:08:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:08:40 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:08:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:40 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c 1073741824 Sep 25 17:08:41 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:41 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c 1073741824" returned: 0 in 0.705s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:41 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c Sep 25 17:08:41 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:42 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c" returned: 0 in 0.374s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:08:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798b1ac2-8c0e-46d9-8232-2856d87e830d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394f8f0f-36a7-4b2e-a4bf-902d042f3816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:42 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Volume volume-bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c (bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c): created successfully Sep 25 17:08:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394f8f0f-36a7-4b2e-a4bf-902d042f3816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Flow 'volume_create_manager' (0f1eb3df-7484-481a-88c4-0500a7794c58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:08:42 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-86d43dcb-b353-445a-9638-37187530adaf tempest-VolumesTransfersV357Test-272977953 None] Created volume successfully. Sep 25 17:08:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-00bab534-4fee-4a22-aab6-ca6670d4f5c3 tempest-VolumesTransfersV357Test-1024173056 None] Acquiring lock "cinder-bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-00bab534-4fee-4a22-aab6-ca6670d4f5c3 tempest-VolumesTransfersV357Test-1024173056 None] Lock "cinder-bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-00bab534-4fee-4a22-aab6-ca6670d4f5c3 tempest-VolumesTransfersV357Test-1024173056 None] Acquiring lock "cinder-quobyte-bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-00bab534-4fee-4a22-aab6-ca6670d4f5c3 tempest-VolumesTransfersV357Test-1024173056 None] Lock "cinder-quobyte-bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c" acquired by "delete_volume" :: waited 0.039s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:43 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d3fb0a-9116-4f1f-893e-020d12826b1e]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:08:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-00bab534-4fee-4a22-aab6-ca6670d4f5c3 tempest-VolumesTransfersV357Test-1024173056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:43 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c Sep 25 17:08:43 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:44 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-00bab534-4fee-4a22-aab6-ca6670d4f5c3 tempest-VolumesTransfersV357Test-1024173056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c" returned: 0 in 0.589s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-00bab534-4fee-4a22-aab6-ca6670d4f5c3 tempest-VolumesTransfersV357Test-1024173056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:44 devstack sudo[93452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c Sep 25 17:08:44 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:44 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-00bab534-4fee-4a22-aab6-ca6670d4f5c3 tempest-VolumesTransfersV357Test-1024173056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c" returned: 0 in 0.419s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:44 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-00bab534-4fee-4a22-aab6-ca6670d4f5c3 tempest-VolumesTransfersV357Test-1024173056 None] Lock "cinder-quobyte-bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c" released by "delete_volume" :: held 1.088s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:44 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-00bab534-4fee-4a22-aab6-ca6670d4f5c3 tempest-VolumesTransfersV357Test-1024173056 None] Created reservations ['5f933cd7-b2fb-4829-b3eb-a68142637d4d', 'a2487ed2-ae1d-4d63-aec9-acb00cff32e3', '81887086-c344-4efb-a0cb-a7e11f70efbb', '4a5f8fe1-20ca-4ef4-8910-c3248acd59cf'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:08:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-00bab534-4fee-4a22-aab6-ca6670d4f5c3 tempest-VolumesTransfersV357Test-1024173056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-00bab534-4fee-4a22-aab6-ca6670d4f5c3 tempest-VolumesTransfersV357Test-1024173056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-00bab534-4fee-4a22-aab6-ca6670d4f5c3 tempest-VolumesTransfersV357Test-1024173056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-00bab534-4fee-4a22-aab6-ca6670d4f5c3 tempest-VolumesTransfersV357Test-1024173056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-00bab534-4fee-4a22-aab6-ca6670d4f5c3 tempest-VolumesTransfersV357Test-1024173056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-00bab534-4fee-4a22-aab6-ca6670d4f5c3 tempest-VolumesTransfersV357Test-1024173056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:44 devstack sudo[93455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:08:44 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:45 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-00bab534-4fee-4a22-aab6-ca6670d4f5c3 tempest-VolumesTransfersV357Test-1024173056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.357s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:45 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-00bab534-4fee-4a22-aab6-ca6670d4f5c3 tempest-VolumesTransfersV357Test-1024173056 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:08:45 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-00bab534-4fee-4a22-aab6-ca6670d4f5c3 tempest-VolumesTransfersV357Test-1024173056 None] Deleted volume successfully. Sep 25 17:08:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-00bab534-4fee-4a22-aab6-ca6670d4f5c3 tempest-VolumesTransfersV357Test-1024173056 None] Lock "cinder-bcab7329-9a5e-4ccd-bd38-ac1824ab5c6c-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5dd50342-840f-4d66-932f-1fba5e07488e tempest-ServerRescueNegativeTestJSON-134655046 None] Acquiring lock "cinder-b7a05a4a-813a-41a1-bdee-a4c9a76937dc-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5dd50342-840f-4d66-932f-1fba5e07488e tempest-ServerRescueNegativeTestJSON-134655046 None] Lock "cinder-b7a05a4a-813a-41a1-bdee-a4c9a76937dc-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5dd50342-840f-4d66-932f-1fba5e07488e tempest-ServerRescueNegativeTestJSON-134655046 None] Acquiring lock "cinder-quobyte-b7a05a4a-813a-41a1-bdee-a4c9a76937dc" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5dd50342-840f-4d66-932f-1fba5e07488e tempest-ServerRescueNegativeTestJSON-134655046 None] Lock "cinder-quobyte-b7a05a4a-813a-41a1-bdee-a4c9a76937dc" acquired by "delete_volume" :: waited 0.066s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:50 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f579b7f0-9772-4df0-9930-55ec0acd9abd]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:08:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5dd50342-840f-4d66-932f-1fba5e07488e tempest-ServerRescueNegativeTestJSON-134655046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b7a05a4a-813a-41a1-bdee-a4c9a76937dc {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:51 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b7a05a4a-813a-41a1-bdee-a4c9a76937dc Sep 25 17:08:51 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:52 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5dd50342-840f-4d66-932f-1fba5e07488e tempest-ServerRescueNegativeTestJSON-134655046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b7a05a4a-813a-41a1-bdee-a4c9a76937dc" returned: 0 in 1.166s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5dd50342-840f-4d66-932f-1fba5e07488e tempest-ServerRescueNegativeTestJSON-134655046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b7a05a4a-813a-41a1-bdee-a4c9a76937dc {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:52 devstack sudo[93550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b7a05a4a-813a-41a1-bdee-a4c9a76937dc Sep 25 17:08:52 devstack sudo[93550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:52 devstack sudo[93550]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5dd50342-840f-4d66-932f-1fba5e07488e tempest-ServerRescueNegativeTestJSON-134655046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b7a05a4a-813a-41a1-bdee-a4c9a76937dc" returned: 0 in 0.533s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:52 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5dd50342-840f-4d66-932f-1fba5e07488e tempest-ServerRescueNegativeTestJSON-134655046 None] Lock "cinder-quobyte-b7a05a4a-813a-41a1-bdee-a4c9a76937dc" released by "delete_volume" :: held 1.872s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:52 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-5dd50342-840f-4d66-932f-1fba5e07488e tempest-ServerRescueNegativeTestJSON-134655046 None] Created reservations ['133702c0-0509-4cd0-8c82-14c6ff9a533f', 'cef1781e-6721-4f65-9fab-b5f9a82a6fbc', '78082f2d-be37-4b62-9ba2-d510e68599a2', '63f95e24-c72a-47e0-921a-ff5a47f68a57'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:08:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5dd50342-840f-4d66-932f-1fba5e07488e tempest-ServerRescueNegativeTestJSON-134655046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5dd50342-840f-4d66-932f-1fba5e07488e tempest-ServerRescueNegativeTestJSON-134655046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5dd50342-840f-4d66-932f-1fba5e07488e tempest-ServerRescueNegativeTestJSON-134655046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5dd50342-840f-4d66-932f-1fba5e07488e tempest-ServerRescueNegativeTestJSON-134655046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5dd50342-840f-4d66-932f-1fba5e07488e tempest-ServerRescueNegativeTestJSON-134655046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5dd50342-840f-4d66-932f-1fba5e07488e tempest-ServerRescueNegativeTestJSON-134655046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:53 devstack sudo[93558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:08:53 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:08:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:53 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5dd50342-840f-4d66-932f-1fba5e07488e tempest-ServerRescueNegativeTestJSON-134655046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.729s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:53 devstack sudo[93562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:08:53 devstack sudo[93562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:53 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-5dd50342-840f-4d66-932f-1fba5e07488e tempest-ServerRescueNegativeTestJSON-134655046 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:08:53 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-5dd50342-840f-4d66-932f-1fba5e07488e tempest-ServerRescueNegativeTestJSON-134655046 None] Deleted volume successfully. Sep 25 17:08:53 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5dd50342-840f-4d66-932f-1fba5e07488e tempest-ServerRescueNegativeTestJSON-134655046 None] Lock "cinder-b7a05a4a-813a-41a1-bdee-a4c9a76937dc-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:54 devstack sudo[93562]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.547s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:54 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:08:54 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:08:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 28 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:08:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:08:56 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-0e710e39-56ed-46ea-be02-7c320d9e1cc5 req-dd66e548-5bcc-4801-b30b-605913d748a1 tempest-ServerActionsTestOtherA-902126569 None] Terminate volume connection completed successfully. Sep 25 17:08:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-0e710e39-56ed-46ea-be02-7c320d9e1cc5 req-dd66e548-5bcc-4801-b30b-605913d748a1 tempest-ServerActionsTestOtherA-902126569 None] Deleting attachment 98b01ee7-1b29-4759-bc5c-1bc6cf5e4da0. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:08:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-0e710e39-56ed-46ea-be02-7c320d9e1cc5 req-5ebe00c0-6b12-4181-9a37-4cbf49ef4192 tempest-ServerActionsTestOtherA-902126569 None] Acquiring lock "cinder-73576bfa-8140-4462-9241-7fa212287974-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-0e710e39-56ed-46ea-be02-7c320d9e1cc5 req-5ebe00c0-6b12-4181-9a37-4cbf49ef4192 tempest-ServerActionsTestOtherA-902126569 None] Lock "cinder-73576bfa-8140-4462-9241-7fa212287974-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-0e710e39-56ed-46ea-be02-7c320d9e1cc5 req-5ebe00c0-6b12-4181-9a37-4cbf49ef4192 tempest-ServerActionsTestOtherA-902126569 None] Acquiring lock "cinder-quobyte-73576bfa-8140-4462-9241-7fa212287974" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-0e710e39-56ed-46ea-be02-7c320d9e1cc5 req-5ebe00c0-6b12-4181-9a37-4cbf49ef4192 tempest-ServerActionsTestOtherA-902126569 None] Lock "cinder-quobyte-73576bfa-8140-4462-9241-7fa212287974" acquired by "delete_volume" :: waited 0.029s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:56 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f778b6eb-b608-46d9-8919-506a372e3c15]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:08:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-0e710e39-56ed-46ea-be02-7c320d9e1cc5 req-5ebe00c0-6b12-4181-9a37-4cbf49ef4192 tempest-ServerActionsTestOtherA-902126569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-73576bfa-8140-4462-9241-7fa212287974 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:57 devstack sudo[93597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-73576bfa-8140-4462-9241-7fa212287974 Sep 25 17:08:57 devstack sudo[93597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:57 devstack sudo[93597]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-0e710e39-56ed-46ea-be02-7c320d9e1cc5 req-5ebe00c0-6b12-4181-9a37-4cbf49ef4192 tempest-ServerActionsTestOtherA-902126569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-73576bfa-8140-4462-9241-7fa212287974" returned: 0 in 0.924s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-0e710e39-56ed-46ea-be02-7c320d9e1cc5 req-5ebe00c0-6b12-4181-9a37-4cbf49ef4192 tempest-ServerActionsTestOtherA-902126569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-73576bfa-8140-4462-9241-7fa212287974 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:57 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-73576bfa-8140-4462-9241-7fa212287974 Sep 25 17:08:57 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:58 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-0e710e39-56ed-46ea-be02-7c320d9e1cc5 req-5ebe00c0-6b12-4181-9a37-4cbf49ef4192 tempest-ServerActionsTestOtherA-902126569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-73576bfa-8140-4462-9241-7fa212287974" returned: 0 in 0.429s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-0e710e39-56ed-46ea-be02-7c320d9e1cc5 req-5ebe00c0-6b12-4181-9a37-4cbf49ef4192 tempest-ServerActionsTestOtherA-902126569 None] Lock "cinder-quobyte-73576bfa-8140-4462-9241-7fa212287974" released by "delete_volume" :: held 1.479s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:58 devstack cinder-volume[87211]: DEBUG cinder.quota [req-0e710e39-56ed-46ea-be02-7c320d9e1cc5 req-5ebe00c0-6b12-4181-9a37-4cbf49ef4192 tempest-ServerActionsTestOtherA-902126569 None] Created reservations ['80e2979c-0daf-4acd-a38d-ae5cd0d19fcf', '9d834af7-e3cb-436b-8522-37c5a54b0714', '595dc647-d525-4f3c-9db6-0cdb0debd6a0', 'ff0a1470-0370-4363-b679-b0bd730acd52'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:08:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-0e710e39-56ed-46ea-be02-7c320d9e1cc5 req-5ebe00c0-6b12-4181-9a37-4cbf49ef4192 tempest-ServerActionsTestOtherA-902126569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-0e710e39-56ed-46ea-be02-7c320d9e1cc5 req-5ebe00c0-6b12-4181-9a37-4cbf49ef4192 tempest-ServerActionsTestOtherA-902126569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:58 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [req-0e710e39-56ed-46ea-be02-7c320d9e1cc5 req-5ebe00c0-6b12-4181-9a37-4cbf49ef4192 tempest-ServerActionsTestOtherA-902126569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:58 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [req-0e710e39-56ed-46ea-be02-7c320d9e1cc5 req-5ebe00c0-6b12-4181-9a37-4cbf49ef4192 tempest-ServerActionsTestOtherA-902126569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-0e710e39-56ed-46ea-be02-7c320d9e1cc5 req-5ebe00c0-6b12-4181-9a37-4cbf49ef4192 tempest-ServerActionsTestOtherA-902126569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-0e710e39-56ed-46ea-be02-7c320d9e1cc5 req-5ebe00c0-6b12-4181-9a37-4cbf49ef4192 tempest-ServerActionsTestOtherA-902126569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:58 devstack sudo[93606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:08:58 devstack sudo[93606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5ba3f555-3db7-430a-9ccc-31cf0641a230 tempest-ServerActionsTestOtherA-902126569 None] Acquiring lock "cinder-fe3d1f17-0ca2-4009-971b-bd622a5e0354-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5ba3f555-3db7-430a-9ccc-31cf0641a230 tempest-ServerActionsTestOtherA-902126569 None] Lock "cinder-fe3d1f17-0ca2-4009-971b-bd622a5e0354-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5ba3f555-3db7-430a-9ccc-31cf0641a230 tempest-ServerActionsTestOtherA-902126569 None] Acquiring lock "cinder-quobyte-fe3d1f17-0ca2-4009-971b-bd622a5e0354" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5ba3f555-3db7-430a-9ccc-31cf0641a230 tempest-ServerActionsTestOtherA-902126569 None] Lock "cinder-quobyte-fe3d1f17-0ca2-4009-971b-bd622a5e0354" acquired by "delete_volume" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:58 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[41064c70-1c04-46f4-b161-59d9d567edcb]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:08:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5ba3f555-3db7-430a-9ccc-31cf0641a230 tempest-ServerActionsTestOtherA-902126569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fe3d1f17-0ca2-4009-971b-bd622a5e0354 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:58 devstack sudo[93606]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-0e710e39-56ed-46ea-be02-7c320d9e1cc5 req-5ebe00c0-6b12-4181-9a37-4cbf49ef4192 tempest-ServerActionsTestOtherA-902126569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.516s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:58 devstack cinder-volume[87211]: DEBUG cinder.manager [req-0e710e39-56ed-46ea-be02-7c320d9e1cc5 req-5ebe00c0-6b12-4181-9a37-4cbf49ef4192 tempest-ServerActionsTestOtherA-902126569 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:08:58 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-0e710e39-56ed-46ea-be02-7c320d9e1cc5 req-5ebe00c0-6b12-4181-9a37-4cbf49ef4192 tempest-ServerActionsTestOtherA-902126569 None] Deleted volume successfully. Sep 25 17:08:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-0e710e39-56ed-46ea-be02-7c320d9e1cc5 req-5ebe00c0-6b12-4181-9a37-4cbf49ef4192 tempest-ServerActionsTestOtherA-902126569 None] Lock "cinder-73576bfa-8140-4462-9241-7fa212287974-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:59 devstack sudo[93609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fe3d1f17-0ca2-4009-971b-bd622a5e0354 Sep 25 17:08:59 devstack sudo[93609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:59 devstack sudo[93609]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5ba3f555-3db7-430a-9ccc-31cf0641a230 tempest-ServerActionsTestOtherA-902126569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fe3d1f17-0ca2-4009-971b-bd622a5e0354" returned: 0 in 0.601s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5ba3f555-3db7-430a-9ccc-31cf0641a230 tempest-ServerActionsTestOtherA-902126569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fe3d1f17-0ca2-4009-971b-bd622a5e0354 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:59 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fe3d1f17-0ca2-4009-971b-bd622a5e0354 Sep 25 17:08:59 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:59 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5ba3f555-3db7-430a-9ccc-31cf0641a230 tempest-ServerActionsTestOtherA-902126569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fe3d1f17-0ca2-4009-971b-bd622a5e0354" returned: 0 in 0.334s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5ba3f555-3db7-430a-9ccc-31cf0641a230 tempest-ServerActionsTestOtherA-902126569 None] Lock "cinder-quobyte-fe3d1f17-0ca2-4009-971b-bd622a5e0354" released by "delete_volume" :: held 1.030s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:00 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-5ba3f555-3db7-430a-9ccc-31cf0641a230 tempest-ServerActionsTestOtherA-902126569 None] Created reservations ['1a1e73eb-dcef-443b-a8b8-37026a02bdea', '89cadf8a-f467-4592-8fc8-d36067eed1f7', '288e02b9-3028-4d46-b803-a5e6eba282af', '916062ec-80f6-4bf8-8b31-389d1a715b2f'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:09:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5ba3f555-3db7-430a-9ccc-31cf0641a230 tempest-ServerActionsTestOtherA-902126569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5ba3f555-3db7-430a-9ccc-31cf0641a230 tempest-ServerActionsTestOtherA-902126569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:00 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5ba3f555-3db7-430a-9ccc-31cf0641a230 tempest-ServerActionsTestOtherA-902126569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:00 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5ba3f555-3db7-430a-9ccc-31cf0641a230 tempest-ServerActionsTestOtherA-902126569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5ba3f555-3db7-430a-9ccc-31cf0641a230 tempest-ServerActionsTestOtherA-902126569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5ba3f555-3db7-430a-9ccc-31cf0641a230 tempest-ServerActionsTestOtherA-902126569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:00 devstack sudo[93618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:09:00 devstack sudo[93618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:00 devstack sudo[93618]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5ba3f555-3db7-430a-9ccc-31cf0641a230 tempest-ServerActionsTestOtherA-902126569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.443s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:00 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-5ba3f555-3db7-430a-9ccc-31cf0641a230 tempest-ServerActionsTestOtherA-902126569 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:09:00 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-5ba3f555-3db7-430a-9ccc-31cf0641a230 tempest-ServerActionsTestOtherA-902126569 None] Deleted volume successfully. Sep 25 17:09:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5ba3f555-3db7-430a-9ccc-31cf0641a230 tempest-ServerActionsTestOtherA-902126569 None] Lock "cinder-fe3d1f17-0ca2-4009-971b-bd622a5e0354-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:05 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:09:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Flow 'volume_create_manager' (0ee8b5b6-7972-49c9-888a-1d2c44e0d8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:09:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c4ee0f-040b-4760-841d-cf366e0e923c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c4ee0f-040b-4760-841d-cf366e0e923c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1462250196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f818ae-0545-47c5-ab09-ab1ee188f37e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6811c4af49846b49e1e67812ed25543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:06Z,use_quota=True,user_id='9d808b05df774bf7aa2d76c55a5bd9ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b92fe8-5c01-4278-aaac-ed9cc0c5b7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b92fe8-5c01-4278-aaac-ed9cc0c5b7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb485a2-7452-403b-b9f8-6e5d3cf3b47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb485a2-7452-403b-b9f8-6e5d3cf3b47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0f818ae-0545-47c5-ab09-ab1ee188f37e', 'volume_name': 'volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd5a258-6e4e-4908-a2d0-4a8f351ba6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd5a258-6e4e-4908-a2d0-4a8f351ba6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e39bd9-c3e0-456e-9543-f906f145fccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:05 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Volume b0f818ae-0545-47c5-ab09-ab1ee188f37e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e', 'volume_size': 1} Sep 25 17:09:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1462250196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f818ae-0545-47c5-ab09-ab1ee188f37e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6811c4af49846b49e1e67812ed25543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:06Z,use_quota=True,user_id='9d808b05df774bf7aa2d76c55a5bd9ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:09:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Creating volume b0f818ae-0545-47c5-ab09-ab1ee188f37e {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:09:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:09:05 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:09:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:06 devstack sudo[93676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e 1073741824 Sep 25 17:09:06 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:06 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e 1073741824" returned: 0 in 0.695s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:06 devstack sudo[93683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e Sep 25 17:09:06 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:07 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e" returned: 0 in 0.389s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:09:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e39bd9-c3e0-456e-9543-f906f145fccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (009cd23f-cef0-4dcd-abb8-3d72d6d021dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:07 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Volume volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e (b0f818ae-0545-47c5-ab09-ab1ee188f37e): created successfully Sep 25 17:09:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (009cd23f-cef0-4dcd-abb8-3d72d6d021dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Flow 'volume_create_manager' (0ee8b5b6-7972-49c9-888a-1d2c44e0d8ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:09:07 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-a27afc3f-0d7d-4ecd-af1c-031e639db308 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Created volume successfully. Sep 25 17:09:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7081f817-8cb4-4500-b4cf-1ccdb5867651 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7081f817-8cb4-4500-b4cf-1ccdb5867651 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-7081f817-8cb4-4500-b4cf-1ccdb5867651 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Creating offline snapshot 05652d77-440b-42c1-939a-271f72049128 of volume b0f818ae-0545-47c5-ab09-ab1ee188f37e {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:09:08 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1660193-b153-4337-aeb6-d28ff136ad56]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7081f817-8cb4-4500-b4cf-1ccdb5867651 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:08 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e Sep 25 17:09:08 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:08 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7081f817-8cb4-4500-b4cf-1ccdb5867651 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e" returned: 0 in 0.543s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7081f817-8cb4-4500-b4cf-1ccdb5867651 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.05652d77-440b-42c1-939a-271f72049128 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:08 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.05652d77-440b-42c1-939a-271f72049128 1G Sep 25 17:09:08 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:09 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7081f817-8cb4-4500-b4cf-1ccdb5867651 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.05652d77-440b-42c1-939a-271f72049128 1G" returned: 0 in 0.627s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7081f817-8cb4-4500-b4cf-1ccdb5867651 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.05652d77-440b-42c1-939a-271f72049128 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:09 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.05652d77-440b-42c1-939a-271f72049128 Sep 25 17:09:09 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:09 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7081f817-8cb4-4500-b4cf-1ccdb5867651 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.05652d77-440b-42c1-939a-271f72049128" returned: 0 in 0.392s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:09 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-7081f817-8cb4-4500-b4cf-1ccdb5867651 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.05652d77-440b-42c1-939a-271f72049128 is being set with open permissions: ugo+rw Sep 25 17:09:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7081f817-8cb4-4500-b4cf-1ccdb5867651 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.05652d77-440b-42c1-939a-271f72049128 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:09 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.05652d77-440b-42c1-939a-271f72049128 Sep 25 17:09:09 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:10 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7081f817-8cb4-4500-b4cf-1ccdb5867651 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.05652d77-440b-42c1-939a-271f72049128" returned: 0 in 0.517s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7081f817-8cb4-4500-b4cf-1ccdb5867651 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:10 devstack sudo[93706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.info Sep 25 17:09:10 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:10 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7081f817-8cb4-4500-b4cf-1ccdb5867651 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.info" returned: 0 in 0.309s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:10 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-7081f817-8cb4-4500-b4cf-1ccdb5867651 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.info is being set with open permissions: ugo+rw Sep 25 17:09:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7081f817-8cb4-4500-b4cf-1ccdb5867651 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:10 devstack sudo[93710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.info Sep 25 17:09:10 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:11 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7081f817-8cb4-4500-b4cf-1ccdb5867651 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.info" returned: 0 in 0.376s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7081f817-8cb4-4500-b4cf-1ccdb5867651 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.908s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:11 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-7081f817-8cb4-4500-b4cf-1ccdb5867651 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Create snapshot completed successfully Sep 25 17:09:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fc984709-de23-425e-af30-d3e5c603f79e tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Acquiring lock "cinder-05652d77-440b-42c1-939a-271f72049128-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fc984709-de23-425e-af30-d3e5c603f79e tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Lock "cinder-05652d77-440b-42c1-939a-271f72049128-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fc984709-de23-425e-af30-d3e5c603f79e tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Acquiring lock "cinder-quobyte-b0f818ae-0545-47c5-ab09-ab1ee188f37e" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fc984709-de23-425e-af30-d3e5c603f79e tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Lock "cinder-quobyte-b0f818ae-0545-47c5-ab09-ab1ee188f37e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fc984709-de23-425e-af30-d3e5c603f79e tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Acquiring lock "cinder-quobyte-05652d77-440b-42c1-939a-271f72049128" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fc984709-de23-425e-af30-d3e5c603f79e tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Lock "cinder-quobyte-05652d77-440b-42c1-939a-271f72049128" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-fc984709-de23-425e-af30-d3e5c603f79e tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Deleting offline snapshot 05652d77-440b-42c1-939a-271f72049128 of volume b0f818ae-0545-47c5-ab09-ab1ee188f37e {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:09:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-fc984709-de23-425e-af30-d3e5c603f79e tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] snapshot_file for this snap is: volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.05652d77-440b-42c1-939a-271f72049128 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:09:12 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[135bb773-0707-473d-b212-4a0daef21752]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fc984709-de23-425e-af30-d3e5c603f79e tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.05652d77-440b-42c1-939a-271f72049128 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:12 devstack sudo[93713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.05652d77-440b-42c1-939a-271f72049128 Sep 25 17:09:12 devstack sudo[93713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:12 devstack sudo[93713]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fc984709-de23-425e-af30-d3e5c603f79e tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.05652d77-440b-42c1-939a-271f72049128" returned: 0 in 0.493s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-fc984709-de23-425e-af30-d3e5c603f79e tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:09:12 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac928c34-4eac-42d2-a203-ca21e1686d2e]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fc984709-de23-425e-af30-d3e5c603f79e tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:12 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e Sep 25 17:09:12 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:13 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fc984709-de23-425e-af30-d3e5c603f79e tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e" returned: 0 in 0.473s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fc984709-de23-425e-af30-d3e5c603f79e tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.05652d77-440b-42c1-939a-271f72049128 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:13 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.05652d77-440b-42c1-939a-271f72049128 Sep 25 17:09:13 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:13 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fc984709-de23-425e-af30-d3e5c603f79e tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.05652d77-440b-42c1-939a-271f72049128" returned: 0 in 0.570s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fc984709-de23-425e-af30-d3e5c603f79e tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.05652d77-440b-42c1-939a-271f72049128 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:13 devstack sudo[93730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.05652d77-440b-42c1-939a-271f72049128 Sep 25 17:09:13 devstack sudo[93730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:14 devstack sudo[93730]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fc984709-de23-425e-af30-d3e5c603f79e tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e.05652d77-440b-42c1-939a-271f72049128" returned: 0 in 0.375s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:14 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fc984709-de23-425e-af30-d3e5c603f79e tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Lock "cinder-quobyte-05652d77-440b-42c1-939a-271f72049128" released by "_delete_snapshot" :: held 2.099s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:14 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fc984709-de23-425e-af30-d3e5c603f79e tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Lock "cinder-quobyte-b0f818ae-0545-47c5-ab09-ab1ee188f37e" released by "delete_snapshot" :: held 2.140s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:14 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-fc984709-de23-425e-af30-d3e5c603f79e tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Created reservations ['8e72e4ae-f4a3-4dc6-9e25-6d54c7430e23', 'c48e1add-25e9-4d94-90d6-9493cc0b87eb', 'f2114e38-eaa4-4c21-9e7e-e57380b03e27', '5766dc6a-dbad-46ed-a9da-e72830b7fdc2'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:09:14 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-fc984709-de23-425e-af30-d3e5c603f79e tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Delete snapshot completed successfully. Sep 25 17:09:14 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fc984709-de23-425e-af30-d3e5c603f79e tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Lock "cinder-05652d77-440b-42c1-939a-271f72049128-delete_snapshot" released by "delete_snapshot" :: held 2.392s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Flow 'volume_create_manager' (c539441e-1bde-4cec-bab9-dd9dbbefabfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f1ac3e-7176-47b5-b325-9d209a5d7f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f1ac3e-7176-47b5-b325-9d209a5d7f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-464591605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac80a10f-ee36-4310-9e95-5b0a60c5c294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be95c87528e14d0f85740eb57c0c4adc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:15Z,use_quota=True,user_id='c7772f4a8751422fbbba4f6a70f8a19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af63643a-ee43-48f6-a182-984446b804e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af63643a-ee43-48f6-a182-984446b804e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121137ee-9be2-4a22-a486-8777f52a968d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121137ee-9be2-4a22-a486-8777f52a968d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac80a10f-ee36-4310-9e95-5b0a60c5c294', 'volume_name': 'volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61fa99ec-18e3-4161-bdad-1279d90c3e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61fa99ec-18e3-4161-bdad-1279d90c3e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de72bd1e-191d-408b-96fc-2aa1c944d848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:15 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Volume ac80a10f-ee36-4310-9e95-5b0a60c5c294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294', 'volume_size': 1} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-464591605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac80a10f-ee36-4310-9e95-5b0a60c5c294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be95c87528e14d0f85740eb57c0c4adc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:15Z,use_quota=True,user_id='c7772f4a8751422fbbba4f6a70f8a19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Creating volume ac80a10f-ee36-4310-9e95-5b0a60c5c294 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:09:15 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2e90a9af-5818-47b5-9c6e-9939e5ebf004 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Acquiring lock "cinder-b0f818ae-0545-47c5-ab09-ab1ee188f37e-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:15 devstack sudo[93733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 1073741824 Sep 25 17:09:15 devstack sudo[93733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2e90a9af-5818-47b5-9c6e-9939e5ebf004 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Lock "cinder-b0f818ae-0545-47c5-ab09-ab1ee188f37e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2e90a9af-5818-47b5-9c6e-9939e5ebf004 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Acquiring lock "cinder-quobyte-b0f818ae-0545-47c5-ab09-ab1ee188f37e" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2e90a9af-5818-47b5-9c6e-9939e5ebf004 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Lock "cinder-quobyte-b0f818ae-0545-47c5-ab09-ab1ee188f37e" acquired by "delete_volume" :: waited 0.022s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef1ce2f-1872-490e-86eb-35e4eb1e06a9]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2e90a9af-5818-47b5-9c6e-9939e5ebf004 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:15 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e Sep 25 17:09:15 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:16 devstack sudo[93733]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 1073741824" returned: 0 in 0.689s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:16 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:16 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 Sep 25 17:09:16 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2e90a9af-5818-47b5-9c6e-9939e5ebf004 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e" returned: 0 in 0.610s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2e90a9af-5818-47b5-9c6e-9939e5ebf004 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:16 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e Sep 25 17:09:16 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:16 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294" returned: 0 in 0.451s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:09:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:16 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2e90a9af-5818-47b5-9c6e-9939e5ebf004 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b0f818ae-0545-47c5-ab09-ab1ee188f37e" returned: 0 in 0.422s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de72bd1e-191d-408b-96fc-2aa1c944d848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558f2c04-2209-413f-8500-0a39cd237109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:16 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2e90a9af-5818-47b5-9c6e-9939e5ebf004 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Lock "cinder-quobyte-b0f818ae-0545-47c5-ab09-ab1ee188f37e" released by "delete_volume" :: held 1.157s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:16 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Volume volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 (ac80a10f-ee36-4310-9e95-5b0a60c5c294): created successfully Sep 25 17:09:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558f2c04-2209-413f-8500-0a39cd237109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Flow 'volume_create_manager' (c539441e-1bde-4cec-bab9-dd9dbbefabfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:09:16 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-2ea049d1-7e45-431d-a741-eecca088f20b tempest-VolumesActionsTest-1887325160 None] Created volume successfully. Sep 25 17:09:16 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-2e90a9af-5818-47b5-9c6e-9939e5ebf004 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Created reservations ['a66e1d7a-f346-4cdb-b500-6165c558e252', 'f5f2ce47-b570-409d-8b5b-46f82c15eb3e', 'ded61e8b-79f4-48c7-846f-bdf2ecc28ef9', '209b883e-cc67-40c5-bc2d-ae9c743d82eb'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:09:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2e90a9af-5818-47b5-9c6e-9939e5ebf004 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2e90a9af-5818-47b5-9c6e-9939e5ebf004 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-2e90a9af-5818-47b5-9c6e-9939e5ebf004 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-2e90a9af-5818-47b5-9c6e-9939e5ebf004 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2e90a9af-5818-47b5-9c6e-9939e5ebf004 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2e90a9af-5818-47b5-9c6e-9939e5ebf004 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:16 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:09:16 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:17 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2e90a9af-5818-47b5-9c6e-9939e5ebf004 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.276s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:17 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-2e90a9af-5818-47b5-9c6e-9939e5ebf004 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:09:17 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-2e90a9af-5818-47b5-9c6e-9939e5ebf004 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Deleted volume successfully. Sep 25 17:09:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2e90a9af-5818-47b5-9c6e-9939e5ebf004 tempest-VolumeSnapshotQuotasNegativeTestJSON-658049798 None] Lock "cinder-b0f818ae-0545-47c5-ab09-ab1ee188f37e-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:26 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=54,cinder:UPDATE=74,cinder:DELETE=6,cinder:INSERT=14 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:09:27 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=48,cinder:INSERT=20,cinder:UPDATE=67,cinder:DELETE=6 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:09:36 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:09:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Flow 'volume_create_manager' (c4d5dffb-00f9-40d1-8a89-5a9fab119a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:09:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c00ac4-c42b-41ae-9976-d60e74a4419d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c00ac4-c42b-41ae-9976-d60e74a4419d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1482374171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be37a1c8-999c-4c62-8181-3b5fd456b1f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa7a91d1464d4b1ea9b602c0882bd5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:36Z,use_quota=True,user_id='f94bf48bda58486b95ac6d75b632cc86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be7a2fe-5027-4305-aa58-af9f23e62c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be7a2fe-5027-4305-aa58-af9f23e62c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9291e65f-d55e-4463-a4eb-e71a95ea07a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:36 devstack cinder-volume[87211]: DEBUG cinder.image.glance [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Creating Keystone auth plugin from conf {{(pid=87211) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 17:09:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9291e65f-d55e-4463-a4eb-e71a95ea07a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'be37a1c8-999c-4c62-8181-3b5fd456b1f2', 'volume_name': 'volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2', 'volume_size': 1, 'image_id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'acaf9a5e9cfc4af3b32eda10c91e30fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'created_at': datetime.datetime(2026, 9, 25, 14, 58, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22ad910-a20e-46d3-9140-461c50ceb5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22ad910-a20e-46d3-9140-461c50ceb5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f807b6-d642-413f-981f-f6a220d619dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:36 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Volume be37a1c8-999c-4c62-8181-3b5fd456b1f2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2', 'volume_size': 1, 'image_id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'acaf9a5e9cfc4af3b32eda10c91e30fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'created_at': datetime.datetime(2026, 9, 25, 14, 58, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 17:09:36 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Trying to clone be37a1c8-999c-4c62-8181-3b5fd456b1f2 from image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}]). {{(pid=87211) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 17:09:37 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_jp1haf5hdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 17:09:37 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Image download 20.69 MB at 20.69 MB/s Sep 25 17:09:37 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4feae41e-7be1-4781-8f6f-84e296954298]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_jp1haf5hdevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:37 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_jp1haf5hdevstack@QuobyteHD Sep 25 17:09:37 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:37 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_jp1haf5hdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:37 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Temporary image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 is fetched for user f94bf48bda58486b95ac6d75b632cc86. {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 17:09:37 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8e9743-c98c-4859-9288-e83216e2f801]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_jp1haf5hdevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:38 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_jp1haf5hdevstack@QuobyteHD Sep 25 17:09:38 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:38 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_jp1haf5hdevstack@QuobyteHD" returned: 0 in 0.539s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1482374171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be37a1c8-999c-4c62-8181-3b5fd456b1f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa7a91d1464d4b1ea9b602c0882bd5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:36Z,use_quota=True,user_id='f94bf48bda58486b95ac6d75b632cc86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:09:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Creating volume be37a1c8-999c-4c62-8181-3b5fd456b1f2 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:09:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:09:38 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:09:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:38 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2 1073741824 Sep 25 17:09:38 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:39 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2 1073741824" returned: 0 in 0.766s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:39 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2 Sep 25 17:09:39 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:39 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2" returned: 0 in 0.384s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:09:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:39 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Attempting download of 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}])) to volume be37a1c8-999c-4c62-8181-3b5fd456b1f2. {{(pid=87211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 17:09:39 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[2719f9cc-9905-4353-b773-8cb144d0bdc0]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_wjmpuzal {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:40 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_wjmpuzal Sep 25 17:09:40 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:40 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_wjmpuzal" returned: 0 in 0.694s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_wjmpuzal {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3c9c7380-74f5-46fd-8fc6-f1e32e6a3cc6 tempest-VolumesActionsTest-1887325160 None] Acquiring lock "cinder-ac80a10f-ee36-4310-9e95-5b0a60c5c294" by "attach_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3c9c7380-74f5-46fd-8fc6-f1e32e6a3cc6 tempest-VolumesActionsTest-1887325160 None] Lock "cinder-ac80a10f-ee36-4310-9e95-5b0a60c5c294" acquired by "attach_volume" :: waited 0.048s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:40 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-3c9c7380-74f5-46fd-8fc6-f1e32e6a3cc6 tempest-VolumesActionsTest-1887325160 None] Attaching volume ac80a10f-ee36-4310-9e95-5b0a60c5c294 to instance d3e39a33-4a3e-43eb-b941-143d66711915 at mountpoint /dev/vdb on host None. Sep 25 17:09:40 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_wjmpuzal Sep 25 17:09:40 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:40 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-3c9c7380-74f5-46fd-8fc6-f1e32e6a3cc6 tempest-VolumesActionsTest-1887325160 None] Attach volume completed successfully. Sep 25 17:09:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3c9c7380-74f5-46fd-8fc6-f1e32e6a3cc6 tempest-VolumesActionsTest-1887325160 None] Lock "cinder-ac80a10f-ee36-4310-9e95-5b0a60c5c294" released by "attach_volume" :: held 0.264s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:41 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-09ba3730-b6c3-49d7-9459-9ca92dd5f2e9 tempest-VolumesActionsTest-1887325160 None] Acquiring lock "cinder-ac80a10f-ee36-4310-9e95-5b0a60c5c294-detach_volume" by "detach_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:41 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-09ba3730-b6c3-49d7-9459-9ca92dd5f2e9 tempest-VolumesActionsTest-1887325160 None] Lock "cinder-ac80a10f-ee36-4310-9e95-5b0a60c5c294-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:41 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-09ba3730-b6c3-49d7-9459-9ca92dd5f2e9 tempest-VolumesActionsTest-1887325160 None] Detaching volume ac80a10f-ee36-4310-9e95-5b0a60c5c294 from instance d3e39a33-4a3e-43eb-b941-143d66711915. Sep 25 17:09:41 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_wjmpuzal" returned: 1 in 0.812s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_wjmpuzal' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:09:41 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[209654a8-193a-48c1-973f-19338b9801db]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_jp1haf5hdevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:41 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-09ba3730-b6c3-49d7-9459-9ca92dd5f2e9 tempest-VolumesActionsTest-1887325160 None] Detach volume completed successfully. Sep 25 17:09:41 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-09ba3730-b6c3-49d7-9459-9ca92dd5f2e9 tempest-VolumesActionsTest-1887325160 None] Lock "cinder-ac80a10f-ee36-4310-9e95-5b0a60c5c294-detach_volume" released by "detach_volume" :: held 0.269s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:41 devstack sudo[93943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_jp1haf5hdevstack@QuobyteHD Sep 25 17:09:41 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:42 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_jp1haf5hdevstack@QuobyteHD" returned: 0 in 0.645s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:42 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 was qcow2, converting to qcow2 {{(pid=87211) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 17:09:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_jp1haf5hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:42 devstack sudo[93959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_jp1haf5hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2 Sep 25 17:09:42 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:44 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_jp1haf5hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2" returned: 0 in 2.817s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:44 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_jp1haf5hdevstack@QuobyteHD, size 112.00 MB, duration 2.82 sec, destination /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2 {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:09:44 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Converted 112.00 MB image at 39.74 MB/s Sep 25 17:09:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:44 devstack sudo[93993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2 1G Sep 25 17:09:44 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:45 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2 1G" returned: 0 in 0.486s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:45 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Downloaded image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}])) to volume be37a1c8-999c-4c62-8181-3b5fd456b1f2 successfully. {{(pid=87211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 17:09:45 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Temporary image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 for user f94bf48bda58486b95ac6d75b632cc86 is deleted. {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 17:09:45 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Marking volume be37a1c8-999c-4c62-8181-3b5fd456b1f2 as bootable. {{(pid=87211) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 17:09:45 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Copying metadata from image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 to be37a1c8-999c-4c62-8181-3b5fd456b1f2. {{(pid=87211) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 17:09:45 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Creating volume glance metadata for volume be37a1c8-999c-4c62-8181-3b5fd456b1f2 backed by image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87211) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 17:09:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f807b6-d642-413f-981f-f6a220d619dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2', 'volume_size': 1, 'image_id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'acaf9a5e9cfc4af3b32eda10c91e30fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'created_at': datetime.datetime(2026, 9, 25, 14, 58, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947f469c-36be-4920-a6b4-350b1f1a65db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:45 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Volume volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2 (be37a1c8-999c-4c62-8181-3b5fd456b1f2): created successfully Sep 25 17:09:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947f469c-36be-4920-a6b4-350b1f1a65db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Flow 'volume_create_manager' (c4d5dffb-00f9-40d1-8a89-5a9fab119a75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:09:45 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-31eb1722-bf51-429f-ada2-d665a28fe7b2 tempest-VolumesImageMetadata-215477518 None] Created volume successfully. Sep 25 17:09:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-aea46ab5-ad51-4477-86a4-b24bfcf0c5c7 tempest-VolumesImageMetadata-215477518 None] Acquiring lock "cinder-be37a1c8-999c-4c62-8181-3b5fd456b1f2-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-aea46ab5-ad51-4477-86a4-b24bfcf0c5c7 tempest-VolumesImageMetadata-215477518 None] Lock "cinder-be37a1c8-999c-4c62-8181-3b5fd456b1f2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-aea46ab5-ad51-4477-86a4-b24bfcf0c5c7 tempest-VolumesImageMetadata-215477518 None] Acquiring lock "cinder-quobyte-be37a1c8-999c-4c62-8181-3b5fd456b1f2" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-aea46ab5-ad51-4477-86a4-b24bfcf0c5c7 tempest-VolumesImageMetadata-215477518 None] Lock "cinder-quobyte-be37a1c8-999c-4c62-8181-3b5fd456b1f2" acquired by "delete_volume" :: waited 0.032s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:47 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[48402a54-4354-4198-af48-bb5eafafc6c7]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aea46ab5-ad51-4477-86a4-b24bfcf0c5c7 tempest-VolumesImageMetadata-215477518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:47 devstack sudo[94084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2 Sep 25 17:09:47 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:48 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aea46ab5-ad51-4477-86a4-b24bfcf0c5c7 tempest-VolumesImageMetadata-215477518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2" returned: 0 in 0.630s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aea46ab5-ad51-4477-86a4-b24bfcf0c5c7 tempest-VolumesImageMetadata-215477518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:48 devstack sudo[94091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2 Sep 25 17:09:48 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:48 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aea46ab5-ad51-4477-86a4-b24bfcf0c5c7 tempest-VolumesImageMetadata-215477518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-be37a1c8-999c-4c62-8181-3b5fd456b1f2" returned: 0 in 0.380s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:48 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-aea46ab5-ad51-4477-86a4-b24bfcf0c5c7 tempest-VolumesImageMetadata-215477518 None] Lock "cinder-quobyte-be37a1c8-999c-4c62-8181-3b5fd456b1f2" released by "delete_volume" :: held 1.103s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:48 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-aea46ab5-ad51-4477-86a4-b24bfcf0c5c7 tempest-VolumesImageMetadata-215477518 None] Created reservations ['76fc654a-7941-4a17-a9b6-5ab212752006', '9ee81a48-dc1a-47a6-9350-6545fbf88032', '03b662d8-5c01-4535-a3a0-2fc26835a45c', '8801f198-7af8-4cbd-8bcd-9221cd90693a'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:09:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-aea46ab5-ad51-4477-86a4-b24bfcf0c5c7 tempest-VolumesImageMetadata-215477518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-aea46ab5-ad51-4477-86a4-b24bfcf0c5c7 tempest-VolumesImageMetadata-215477518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-aea46ab5-ad51-4477-86a4-b24bfcf0c5c7 tempest-VolumesImageMetadata-215477518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-aea46ab5-ad51-4477-86a4-b24bfcf0c5c7 tempest-VolumesImageMetadata-215477518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-aea46ab5-ad51-4477-86a4-b24bfcf0c5c7 tempest-VolumesImageMetadata-215477518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aea46ab5-ad51-4477-86a4-b24bfcf0c5c7 tempest-VolumesImageMetadata-215477518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:49 devstack sudo[94098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:09:49 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:49 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aea46ab5-ad51-4477-86a4-b24bfcf0c5c7 tempest-VolumesImageMetadata-215477518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.534s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:49 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-aea46ab5-ad51-4477-86a4-b24bfcf0c5c7 tempest-VolumesImageMetadata-215477518 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:09:49 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-aea46ab5-ad51-4477-86a4-b24bfcf0c5c7 tempest-VolumesImageMetadata-215477518 None] Deleted volume successfully. Sep 25 17:09:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-aea46ab5-ad51-4477-86a4-b24bfcf0c5c7 tempest-VolumesImageMetadata-215477518 None] Lock "cinder-be37a1c8-999c-4c62-8181-3b5fd456b1f2-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:09:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:53 devstack sudo[94138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:09:53 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:54 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.564s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:54 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:09:54 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:09:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 28 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:09:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:09:58 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:UPDATE=18,cinder:SELECT=16,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:09:59 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=26,cinder:UPDATE=13,cinder:INSERT=11,cinder:DELETE=1 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Flow 'volume_create_manager' (439cc41f-e86f-488f-bad9-50cc49bc87b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d934a2c0-c634-4b86-947a-f4fda8704edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d934a2c0-c634-4b86-947a-f4fda8704edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1320568536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff9515d-4daf-4c7a-bf8c-66a503e88ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6971345cc00647a99cfb1bd7a4321204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:01Z,use_quota=True,user_id='a7eecb1b0b0142dcb5aa2296de9a794d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552de9dd-d313-4680-950b-36726155fe78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552de9dd-d313-4680-950b-36726155fe78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d78362a-78d4-46dd-bcc3-0cf28d27d4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d78362a-78d4-46dd-bcc3-0cf28d27d4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cff9515d-4daf-4c7a-bf8c-66a503e88ab1', 'volume_name': 'volume-cff9515d-4daf-4c7a-bf8c-66a503e88ab1', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bedc42fa-6ddd-4a6e-a923-94c355a299f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bedc42fa-6ddd-4a6e-a923-94c355a299f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12cd90b-0fc5-45cc-bb5c-d945ea193ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:01 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Volume cff9515d-4daf-4c7a-bf8c-66a503e88ab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cff9515d-4daf-4c7a-bf8c-66a503e88ab1', 'volume_size': 1} Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1320568536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff9515d-4daf-4c7a-bf8c-66a503e88ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6971345cc00647a99cfb1bd7a4321204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:01Z,use_quota=True,user_id='a7eecb1b0b0142dcb5aa2296de9a794d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Creating volume cff9515d-4daf-4c7a-bf8c-66a503e88ab1 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:10:01 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cff9515d-4daf-4c7a-bf8c-66a503e88ab1 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:01 devstack sudo[94284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cff9515d-4daf-4c7a-bf8c-66a503e88ab1 1073741824 Sep 25 17:10:01 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:01 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cff9515d-4daf-4c7a-bf8c-66a503e88ab1 1073741824" returned: 0 in 0.784s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cff9515d-4daf-4c7a-bf8c-66a503e88ab1 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:02 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cff9515d-4daf-4c7a-bf8c-66a503e88ab1 Sep 25 17:10:02 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:02 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cff9515d-4daf-4c7a-bf8c-66a503e88ab1" returned: 0 in 0.294s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:10:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12cd90b-0fc5-45cc-bb5c-d945ea193ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff9515d-4daf-4c7a-bf8c-66a503e88ab1', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeca2ce8-a779-485b-8a57-b497cb100ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:02 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Volume volume-cff9515d-4daf-4c7a-bf8c-66a503e88ab1 (cff9515d-4daf-4c7a-bf8c-66a503e88ab1): created successfully Sep 25 17:10:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeca2ce8-a779-485b-8a57-b497cb100ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Flow 'volume_create_manager' (439cc41f-e86f-488f-bad9-50cc49bc87b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:10:02 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-c22c159d-9629-4b4b-8305-dbffe899a59d tempest-AbsoluteLimitsTests-338393577 None] Created volume successfully. Sep 25 17:10:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c96a0cbe-015f-41b5-9534-5044e415bcab tempest-AbsoluteLimitsTests-338393577 None] Acquiring lock "cinder-cff9515d-4daf-4c7a-bf8c-66a503e88ab1-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c96a0cbe-015f-41b5-9534-5044e415bcab tempest-AbsoluteLimitsTests-338393577 None] Lock "cinder-cff9515d-4daf-4c7a-bf8c-66a503e88ab1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c96a0cbe-015f-41b5-9534-5044e415bcab tempest-AbsoluteLimitsTests-338393577 None] Acquiring lock "cinder-quobyte-cff9515d-4daf-4c7a-bf8c-66a503e88ab1" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c96a0cbe-015f-41b5-9534-5044e415bcab tempest-AbsoluteLimitsTests-338393577 None] Lock "cinder-quobyte-cff9515d-4daf-4c7a-bf8c-66a503e88ab1" acquired by "delete_volume" :: waited 0.039s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:04 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb38f29-8673-4b84-9459-fae96593f796]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c96a0cbe-015f-41b5-9534-5044e415bcab tempest-AbsoluteLimitsTests-338393577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cff9515d-4daf-4c7a-bf8c-66a503e88ab1 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:04 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cff9515d-4daf-4c7a-bf8c-66a503e88ab1 Sep 25 17:10:04 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-db2bfb76-43c5-4dd6-a0ae-2806fde15804 tempest-VolumesActionsTest-1887325160 None] Acquiring lock "cinder-ac80a10f-ee36-4310-9e95-5b0a60c5c294" by "attach_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-db2bfb76-43c5-4dd6-a0ae-2806fde15804 tempest-VolumesActionsTest-1887325160 None] Lock "cinder-ac80a10f-ee36-4310-9e95-5b0a60c5c294" acquired by "attach_volume" :: waited 0.032s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:04 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-db2bfb76-43c5-4dd6-a0ae-2806fde15804 tempest-VolumesActionsTest-1887325160 None] Attaching volume ac80a10f-ee36-4310-9e95-5b0a60c5c294 to instance 47bbf00f-2f4b-427f-94c4-a58d5bb88aba at mountpoint /dev/vdb on host None. Sep 25 17:10:04 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:04 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-db2bfb76-43c5-4dd6-a0ae-2806fde15804 tempest-VolumesActionsTest-1887325160 None] Attach volume completed successfully. Sep 25 17:10:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c96a0cbe-015f-41b5-9534-5044e415bcab tempest-AbsoluteLimitsTests-338393577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cff9515d-4daf-4c7a-bf8c-66a503e88ab1" returned: 0 in 0.606s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c96a0cbe-015f-41b5-9534-5044e415bcab tempest-AbsoluteLimitsTests-338393577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cff9515d-4daf-4c7a-bf8c-66a503e88ab1 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-db2bfb76-43c5-4dd6-a0ae-2806fde15804 tempest-VolumesActionsTest-1887325160 None] Lock "cinder-ac80a10f-ee36-4310-9e95-5b0a60c5c294" released by "attach_volume" :: held 0.137s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:04 devstack sudo[94360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cff9515d-4daf-4c7a-bf8c-66a503e88ab1 Sep 25 17:10:04 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:05 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c96a0cbe-015f-41b5-9534-5044e415bcab tempest-AbsoluteLimitsTests-338393577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cff9515d-4daf-4c7a-bf8c-66a503e88ab1" returned: 0 in 0.416s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:05 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c96a0cbe-015f-41b5-9534-5044e415bcab tempest-AbsoluteLimitsTests-338393577 None] Lock "cinder-quobyte-cff9515d-4daf-4c7a-bf8c-66a503e88ab1" released by "delete_volume" :: held 1.145s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:05 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-c96a0cbe-015f-41b5-9534-5044e415bcab tempest-AbsoluteLimitsTests-338393577 None] Created reservations ['7b2ec41e-67b1-4e75-9f31-4e9a063d0675', 'fb52474d-7675-41d8-bc5e-7007abc0b2ff', '578a7a10-a3bf-48a4-8841-0ae039f9d054', '1f01de18-dfb3-4696-b80f-e948d5100099'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:10:05 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-03b0d115-69c7-44f2-aec0-6d7ccc408ed5 tempest-VolumesActionsTest-1887325160 None] Acquiring lock "cinder-ac80a10f-ee36-4310-9e95-5b0a60c5c294-detach_volume" by "detach_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:05 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-03b0d115-69c7-44f2-aec0-6d7ccc408ed5 tempest-VolumesActionsTest-1887325160 None] Lock "cinder-ac80a10f-ee36-4310-9e95-5b0a60c5c294-detach_volume" acquired by "detach_volume" :: waited 0.080s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:05 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-03b0d115-69c7-44f2-aec0-6d7ccc408ed5 tempest-VolumesActionsTest-1887325160 None] Detaching volume ac80a10f-ee36-4310-9e95-5b0a60c5c294 from instance 47bbf00f-2f4b-427f-94c4-a58d5bb88aba. Sep 25 17:10:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c96a0cbe-015f-41b5-9534-5044e415bcab tempest-AbsoluteLimitsTests-338393577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c96a0cbe-015f-41b5-9534-5044e415bcab tempest-AbsoluteLimitsTests-338393577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c96a0cbe-015f-41b5-9534-5044e415bcab tempest-AbsoluteLimitsTests-338393577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c96a0cbe-015f-41b5-9534-5044e415bcab tempest-AbsoluteLimitsTests-338393577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c96a0cbe-015f-41b5-9534-5044e415bcab tempest-AbsoluteLimitsTests-338393577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c96a0cbe-015f-41b5-9534-5044e415bcab tempest-AbsoluteLimitsTests-338393577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:05 devstack sudo[94365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:10:05 devstack sudo[94365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:05 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-03b0d115-69c7-44f2-aec0-6d7ccc408ed5 tempest-VolumesActionsTest-1887325160 None] Detach volume completed successfully. Sep 25 17:10:05 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-03b0d115-69c7-44f2-aec0-6d7ccc408ed5 tempest-VolumesActionsTest-1887325160 None] Lock "cinder-ac80a10f-ee36-4310-9e95-5b0a60c5c294-detach_volume" released by "detach_volume" :: held 0.185s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:06 devstack sudo[94365]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c96a0cbe-015f-41b5-9534-5044e415bcab tempest-AbsoluteLimitsTests-338393577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.613s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:06 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-c96a0cbe-015f-41b5-9534-5044e415bcab tempest-AbsoluteLimitsTests-338393577 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:10:06 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-c96a0cbe-015f-41b5-9534-5044e415bcab tempest-AbsoluteLimitsTests-338393577 None] Deleted volume successfully. Sep 25 17:10:06 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c96a0cbe-015f-41b5-9534-5044e415bcab tempest-AbsoluteLimitsTests-338393577 None] Lock "cinder-cff9515d-4daf-4c7a-bf8c-66a503e88ab1-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e81b5fb8-086e-4e9c-a330-729588659b4a tempest-VolumesActionsTest-1887325160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e81b5fb8-086e-4e9c-a330-729588659b4a tempest-VolumesActionsTest-1887325160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:12 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb30319-5d78-46d4-84a8-0c37cab79c26]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e81b5fb8-086e-4e9c-a330-729588659b4a tempest-VolumesActionsTest-1887325160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:12 devstack sudo[94418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 Sep 25 17:10:12 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:12 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e81b5fb8-086e-4e9c-a330-729588659b4a tempest-VolumesActionsTest-1887325160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294" returned: 0 in 0.427s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:12 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5595f3-540f-43ed-a33f-6e802e714d15]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e81b5fb8-086e-4e9c-a330-729588659b4a tempest-VolumesActionsTest-1887325160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:12 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 Sep 25 17:10:12 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:13 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e81b5fb8-086e-4e9c-a330-729588659b4a tempest-VolumesActionsTest-1887325160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294" returned: 0 in 0.497s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e81b5fb8-086e-4e9c-a330-729588659b4a tempest-VolumesActionsTest-1887325160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 /opt/stack/data/cinder/conversion/ac80a10f-ee36-4310-9e95-5b0a60c5c294.temp_image.c1cd6670-a5e3-458f-b20e-eece0182b1d8rkgvsml1.img {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:13 devstack sudo[94428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 /opt/stack/data/cinder/conversion/ac80a10f-ee36-4310-9e95-5b0a60c5c294.temp_image.c1cd6670-a5e3-458f-b20e-eece0182b1d8rkgvsml1.img Sep 25 17:10:13 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:14 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:10:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Flow 'volume_create_manager' (7bfb7f6b-9261-4cab-8311-b602408c4c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:10:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45b2353-3c37-47a5-abac-21417d128a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45b2353-3c37-47a5-abac-21417d128a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-384887676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd0a5fb-9846-410e-874d-9cde5b1d21ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d26b82de79418e87e9b572c4c7bb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:15Z,use_quota=True,user_id='afbd5c05c8324c8e822d14388e942683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba13551-a12c-468e-92ec-6fac205ec3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba13551-a12c-468e-92ec-6fac205ec3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca11948-d3a8-470a-adbf-20c82bf20f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca11948-d3a8-470a-adbf-20c82bf20f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bd0a5fb-9846-410e-874d-9cde5b1d21ae', 'volume_name': 'volume-5bd0a5fb-9846-410e-874d-9cde5b1d21ae', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b55531-d78a-4c26-8b1e-c2a4dfcb6637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b55531-d78a-4c26-8b1e-c2a4dfcb6637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (174083c5-dea6-4264-b3d6-0bef10d963f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:14 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Volume 5bd0a5fb-9846-410e-874d-9cde5b1d21ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bd0a5fb-9846-410e-874d-9cde5b1d21ae', 'volume_size': 1} Sep 25 17:10:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:19 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:10:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Flow 'volume_create_manager' (b0874fcc-271b-4cf4-92da-1196560864e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:10:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7b2fc1-69e1-49bc-bee4-18bbc4ba0740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7b2fc1-69e1-49bc-bee4-18bbc4ba0740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-498320328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89b62f8-d133-433e-89b6-9a51d286c8bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e4fcc8a85f44e2940bc6488db0aa75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:19Z,use_quota=True,user_id='a4083f1f19404f3dbbf294c4c5b107c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d5ecd6-cbf6-4915-9e5e-6ebac8a56a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d5ecd6-cbf6-4915-9e5e-6ebac8a56a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f4f1cb-8d1a-4237-af5d-73d69fc8457f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f4f1cb-8d1a-4237-af5d-73d69fc8457f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c89b62f8-d133-433e-89b6-9a51d286c8bc', 'volume_name': 'volume-c89b62f8-d133-433e-89b6-9a51d286c8bc', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b569fe3f-9fb1-47f4-9852-a41c0f5e2e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b569fe3f-9fb1-47f4-9852-a41c0f5e2e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf868d1-e04f-41fd-a907-0de213931902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:19 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Volume c89b62f8-d133-433e-89b6-9a51d286c8bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c89b62f8-d133-433e-89b6-9a51d286c8bc', 'volume_size': 1} Sep 25 17:10:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:19 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e81b5fb8-086e-4e9c-a330-729588659b4a tempest-VolumesActionsTest-1887325160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 /opt/stack/data/cinder/conversion/ac80a10f-ee36-4310-9e95-5b0a60c5c294.temp_image.c1cd6670-a5e3-458f-b20e-eece0182b1d8rkgvsml1.img" returned: 0 in 6.809s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:19 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09b858b-876f-4466-a127-43de2c0819e3]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e81b5fb8-086e-4e9c-a330-729588659b4a tempest-VolumesActionsTest-1887325160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:20 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 Sep 25 17:10:20 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:20 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e81b5fb8-086e-4e9c-a330-729588659b4a tempest-VolumesActionsTest-1887325160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294" returned: 0 in 0.511s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:20 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-e81b5fb8-086e-4e9c-a330-729588659b4a tempest-VolumesActionsTest-1887325160 None] Image conversion details: src /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294, size 1024.00 MB, duration 6.81 sec, destination /opt/stack/data/cinder/conversion/ac80a10f-ee36-4310-9e95-5b0a60c5c294.temp_image.c1cd6670-a5e3-458f-b20e-eece0182b1d8rkgvsml1.img {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:10:20 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-e81b5fb8-086e-4e9c-a330-729588659b4a tempest-VolumesActionsTest-1887325160 None] Converted 1024.00 MB image at 150.38 MB/s Sep 25 17:10:20 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-e81b5fb8-086e-4e9c-a330-729588659b4a tempest-VolumesActionsTest-1887325160 None] c1cd6670-a5e3-458f-b20e-eece0182b1d8 was raw, no need to convert to raw {{(pid=87211) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 17:10:28 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:10:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Flow 'volume_create_manager' (8a3902db-36a4-4082-a9d1-e199d1d88da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:10:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4389a442-7d88-46d0-a028-6cbc662f2fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4389a442-7d88-46d0-a028-6cbc662f2fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-740083537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bbbd509-0338-4e2d-9c74-0c4268535c90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d87ce40772324790b7e1f75518f3ed61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:29Z,use_quota=True,user_id='b6ca2b3b426146dfa54fd789371d6ed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925e5428-09bc-446d-8967-1abc9099d1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925e5428-09bc-446d-8967-1abc9099d1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec5e3e46-43da-493b-ba6a-78217e184ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec5e3e46-43da-493b-ba6a-78217e184ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bbbd509-0338-4e2d-9c74-0c4268535c90', 'volume_name': 'volume-1bbbd509-0338-4e2d-9c74-0c4268535c90', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e47f7b-cc64-4477-98f4-7258cce67543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e47f7b-cc64-4477-98f4-7258cce67543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515f9cf0-12b1-44eb-84bd-90d20ef25796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:28 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Volume 1bbbd509-0338-4e2d-9c74-0c4268535c90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bbbd509-0338-4e2d-9c74-0c4268535c90', 'volume_size': 1} Sep 25 17:10:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:38 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:UPDATE=17,cinder:SELECT=15,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:10:38 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=21,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=5 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:10:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e81b5fb8-086e-4e9c-a330-729588659b4a tempest-VolumesActionsTest-1887325160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.736s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e81b5fb8-086e-4e9c-a330-729588659b4a tempest-VolumesActionsTest-1887325160 None] Uploaded volume to glance image-id: c1cd6670-a5e3-458f-b20e-eece0182b1d8. {{(pid=87211) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 17:10:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.900s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-384887676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd0a5fb-9846-410e-874d-9cde5b1d21ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d26b82de79418e87e9b572c4c7bb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:15Z,use_quota=True,user_id='afbd5c05c8324c8e822d14388e942683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:10:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Creating volume 5bd0a5fb-9846-410e-874d-9cde5b1d21ae {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:10:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:10:39 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:10:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bd0a5fb-9846-410e-874d-9cde5b1d21ae 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:39 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bd0a5fb-9846-410e-874d-9cde5b1d21ae 1073741824 Sep 25 17:10:39 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:39 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-e81b5fb8-086e-4e9c-a330-729588659b4a tempest-VolumesActionsTest-1887325160 None] Copy volume to image completed successfully. Sep 25 17:10:40 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bd0a5fb-9846-410e-874d-9cde5b1d21ae 1073741824" returned: 0 in 0.514s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bd0a5fb-9846-410e-874d-9cde5b1d21ae {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:40 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bd0a5fb-9846-410e-874d-9cde5b1d21ae Sep 25 17:10:40 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:40 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bd0a5fb-9846-410e-874d-9cde5b1d21ae" returned: 0 in 0.272s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:10:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.381s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-498320328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89b62f8-d133-433e-89b6-9a51d286c8bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e4fcc8a85f44e2940bc6488db0aa75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:19Z,use_quota=True,user_id='a4083f1f19404f3dbbf294c4c5b107c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:10:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Creating volume c89b62f8-d133-433e-89b6-9a51d286c8bc {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:10:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:10:40 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:10:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c89b62f8-d133-433e-89b6-9a51d286c8bc 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:40 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c89b62f8-d133-433e-89b6-9a51d286c8bc 1073741824 Sep 25 17:10:40 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (174083c5-dea6-4264-b3d6-0bef10d963f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bd0a5fb-9846-410e-874d-9cde5b1d21ae', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929d7c16-a782-41c1-a1f2-e2e5ce25f88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:40 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Volume volume-5bd0a5fb-9846-410e-874d-9cde5b1d21ae (5bd0a5fb-9846-410e-874d-9cde5b1d21ae): created successfully Sep 25 17:10:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929d7c16-a782-41c1-a1f2-e2e5ce25f88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Flow 'volume_create_manager' (7bfb7f6b-9261-4cab-8311-b602408c4c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:10:40 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-d5da305b-9fc7-4602-aa1d-369c97d5a082 tempest-VolumesMetadataTest-755763776 None] Created volume successfully. Sep 25 17:10:41 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c89b62f8-d133-433e-89b6-9a51d286c8bc 1073741824" returned: 0 in 0.485s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c89b62f8-d133-433e-89b6-9a51d286c8bc {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:41 devstack sudo[94545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c89b62f8-d133-433e-89b6-9a51d286c8bc Sep 25 17:10:41 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:41 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c89b62f8-d133-433e-89b6-9a51d286c8bc" returned: 0 in 0.278s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:10:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.782s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-740083537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bbbd509-0338-4e2d-9c74-0c4268535c90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d87ce40772324790b7e1f75518f3ed61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:29Z,use_quota=True,user_id='b6ca2b3b426146dfa54fd789371d6ed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:10:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Creating volume 1bbbd509-0338-4e2d-9c74-0c4268535c90 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:10:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:10:41 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:10:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1bbbd509-0338-4e2d-9c74-0c4268535c90 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:41 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1bbbd509-0338-4e2d-9c74-0c4268535c90 1073741824 Sep 25 17:10:41 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf868d1-e04f-41fd-a907-0de213931902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c89b62f8-d133-433e-89b6-9a51d286c8bc', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6842e20a-fdb3-4fcf-877e-0baf7d626251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:41 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Volume volume-c89b62f8-d133-433e-89b6-9a51d286c8bc (c89b62f8-d133-433e-89b6-9a51d286c8bc): created successfully Sep 25 17:10:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6842e20a-fdb3-4fcf-877e-0baf7d626251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Flow 'volume_create_manager' (b0874fcc-271b-4cf4-92da-1196560864e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:10:41 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-5abb8dfc-5579-4dd0-b2d0-6a48528cbc84 tempest-AttachVolumeTestJSON-1624605778 None] Created volume successfully. Sep 25 17:10:42 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1bbbd509-0338-4e2d-9c74-0c4268535c90 1073741824" returned: 0 in 0.493s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1bbbd509-0338-4e2d-9c74-0c4268535c90 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:42 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1bbbd509-0338-4e2d-9c74-0c4268535c90 Sep 25 17:10:42 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:42 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1bbbd509-0338-4e2d-9c74-0c4268535c90" returned: 0 in 0.298s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:10:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.079s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515f9cf0-12b1-44eb-84bd-90d20ef25796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bbbd509-0338-4e2d-9c74-0c4268535c90', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab1474e-4365-4a12-9b2a-935af612b7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:42 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5c0bfa-1d9d-4f8e-8863-edb89eaed19c]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:42 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Volume volume-1bbbd509-0338-4e2d-9c74-0c4268535c90 (1bbbd509-0338-4e2d-9c74-0c4268535c90): created successfully Sep 25 17:10:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab1474e-4365-4a12-9b2a-935af612b7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Flow 'volume_create_manager' (8a3902db-36a4-4082-a9d1-e199d1d88da4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:10:42 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-e5605943-1638-4a42-91bb-098397fbbd80 tempest-AttachVolumeShelveTestJSON-2117417879 None] Created volume successfully. Sep 25 17:10:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-774b44de-e824-4f17-8d56-1a9e98e68f6f tempest-VolumesMetadataTest-755763776 None] Acquiring lock "cinder-5bd0a5fb-9846-410e-874d-9cde5b1d21ae-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:42 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 Sep 25 17:10:42 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-774b44de-e824-4f17-8d56-1a9e98e68f6f tempest-VolumesMetadataTest-755763776 None] Lock "cinder-5bd0a5fb-9846-410e-874d-9cde5b1d21ae-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-774b44de-e824-4f17-8d56-1a9e98e68f6f tempest-VolumesMetadataTest-755763776 None] Acquiring lock "cinder-quobyte-5bd0a5fb-9846-410e-874d-9cde5b1d21ae" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-774b44de-e824-4f17-8d56-1a9e98e68f6f tempest-VolumesMetadataTest-755763776 None] Lock "cinder-quobyte-5bd0a5fb-9846-410e-874d-9cde5b1d21ae" acquired by "delete_volume" :: waited 0.016s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:42 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[714bb3ca-9f7b-4afd-b0f2-05dc3562af25]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-774b44de-e824-4f17-8d56-1a9e98e68f6f tempest-VolumesMetadataTest-755763776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bd0a5fb-9846-410e-874d-9cde5b1d21ae {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:42 devstack sudo[94559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bd0a5fb-9846-410e-874d-9cde5b1d21ae Sep 25 17:10:42 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:42 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294" returned: 0 in 0.450s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:42 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5399e68-94b4-4cd8-a3a9-31a5644acad0]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:43 devstack sudo[94569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 Sep 25 17:10:43 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:43 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-774b44de-e824-4f17-8d56-1a9e98e68f6f tempest-VolumesMetadataTest-755763776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bd0a5fb-9846-410e-874d-9cde5b1d21ae" returned: 0 in 0.438s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-774b44de-e824-4f17-8d56-1a9e98e68f6f tempest-VolumesMetadataTest-755763776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bd0a5fb-9846-410e-874d-9cde5b1d21ae {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:43 devstack sudo[94575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bd0a5fb-9846-410e-874d-9cde5b1d21ae Sep 25 17:10:43 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:43 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294" returned: 0 in 0.441s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 /opt/stack/data/cinder/conversion/ac80a10f-ee36-4310-9e95-5b0a60c5c294.temp_image.229c07f8-cf1d-416f-9e6c-4ebdd99adfe8b5sefchg.img {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:43 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 /opt/stack/data/cinder/conversion/ac80a10f-ee36-4310-9e95-5b0a60c5c294.temp_image.229c07f8-cf1d-416f-9e6c-4ebdd99adfe8b5sefchg.img Sep 25 17:10:43 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:43 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-774b44de-e824-4f17-8d56-1a9e98e68f6f tempest-VolumesMetadataTest-755763776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bd0a5fb-9846-410e-874d-9cde5b1d21ae" returned: 0 in 0.365s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-774b44de-e824-4f17-8d56-1a9e98e68f6f tempest-VolumesMetadataTest-755763776 None] Lock "cinder-quobyte-5bd0a5fb-9846-410e-874d-9cde5b1d21ae" released by "delete_volume" :: held 0.865s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:43 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-774b44de-e824-4f17-8d56-1a9e98e68f6f tempest-VolumesMetadataTest-755763776 None] Created reservations ['e132f573-6110-4dd2-bc46-db74eb5835fc', '858563ec-4db8-43cf-89e5-4955b689fcdb', '885e359f-d9f1-436e-a1d1-c54443ea5d58', '425a0f2f-6b2c-4f7a-9411-7b89df5a1d72'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:10:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-774b44de-e824-4f17-8d56-1a9e98e68f6f tempest-VolumesMetadataTest-755763776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-774b44de-e824-4f17-8d56-1a9e98e68f6f tempest-VolumesMetadataTest-755763776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-774b44de-e824-4f17-8d56-1a9e98e68f6f tempest-VolumesMetadataTest-755763776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-774b44de-e824-4f17-8d56-1a9e98e68f6f tempest-VolumesMetadataTest-755763776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-774b44de-e824-4f17-8d56-1a9e98e68f6f tempest-VolumesMetadataTest-755763776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-774b44de-e824-4f17-8d56-1a9e98e68f6f tempest-VolumesMetadataTest-755763776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:43 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:10:43 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-88e19a49-dd17-4884-81aa-ec7392158948 req-6afe2948-b6e0-4d50-9611-082e10505197 tempest-AttachVolumeTestJSON-1624605778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:44 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-774b44de-e824-4f17-8d56-1a9e98e68f6f tempest-VolumesMetadataTest-755763776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.601s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:44 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-774b44de-e824-4f17-8d56-1a9e98e68f6f tempest-VolumesMetadataTest-755763776 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:10:44 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-774b44de-e824-4f17-8d56-1a9e98e68f6f tempest-VolumesMetadataTest-755763776 None] Deleted volume successfully. Sep 25 17:10:44 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-774b44de-e824-4f17-8d56-1a9e98e68f6f tempest-VolumesMetadataTest-755763776 None] Lock "cinder-5bd0a5fb-9846-410e-874d-9cde5b1d21ae-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 /opt/stack/data/cinder/conversion/ac80a10f-ee36-4310-9e95-5b0a60c5c294.temp_image.229c07f8-cf1d-416f-9e6c-4ebdd99adfe8b5sefchg.img" returned: 0 in 8.260s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:51 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ebf10f-65f3-46d5-bb0d-7e7249212e7e]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:51 devstack sudo[94633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 Sep 25 17:10:51 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:52 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294" returned: 0 in 0.555s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:52 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] Image conversion details: src /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294, size 1024.00 MB, duration 8.26 sec, destination /opt/stack/data/cinder/conversion/ac80a10f-ee36-4310-9e95-5b0a60c5c294.temp_image.229c07f8-cf1d-416f-9e6c-4ebdd99adfe8b5sefchg.img {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:10:52 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] Converted 1024.00 MB image at 123.94 MB/s Sep 25 17:10:52 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] 229c07f8-cf1d-416f-9e6c-4ebdd99adfe8 was raw, converting to qcow2 {{(pid=87211) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 25 17:10:52 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0504614-e6b8-4bab-aa6f-5936140636a5]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ac80a10f-ee36-4310-9e95-5b0a60c5c294.temp_image.229c07f8-cf1d-416f-9e6c-4ebdd99adfe8b5sefchg.img {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:52 devstack sudo[94639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ac80a10f-ee36-4310-9e95-5b0a60c5c294.temp_image.229c07f8-cf1d-416f-9e6c-4ebdd99adfe8b5sefchg.img Sep 25 17:10:52 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:52 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ac80a10f-ee36-4310-9e95-5b0a60c5c294.temp_image.229c07f8-cf1d-416f-9e6c-4ebdd99adfe8b5sefchg.img" returned: 0 in 0.399s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ac80a10f-ee36-4310-9e95-5b0a60c5c294.temp_image.229c07f8-cf1d-416f-9e6c-4ebdd99adfe8b5sefchg.img {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:52 devstack sudo[94643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ac80a10f-ee36-4310-9e95-5b0a60c5c294.temp_image.229c07f8-cf1d-416f-9e6c-4ebdd99adfe8b5sefchg.img Sep 25 17:10:52 devstack sudo[94643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:53 devstack sudo[94643]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ac80a10f-ee36-4310-9e95-5b0a60c5c294.temp_image.229c07f8-cf1d-416f-9e6c-4ebdd99adfe8b5sefchg.img" returned: 1 in 0.420s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ac80a10f-ee36-4310-9e95-5b0a60c5c294.temp_image.229c07f8-cf1d-416f-9e6c-4ebdd99adfe8b5sefchg.img' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:10:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ac80a10f-ee36-4310-9e95-5b0a60c5c294.temp_image.229c07f8-cf1d-416f-9e6c-4ebdd99adfe8b5sefchg.img /opt/stack/data/cinder/conversion/vol_upload_khkefvgd {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:53 devstack sudo[94648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ac80a10f-ee36-4310-9e95-5b0a60c5c294.temp_image.229c07f8-cf1d-416f-9e6c-4ebdd99adfe8b5sefchg.img /opt/stack/data/cinder/conversion/vol_upload_khkefvgd Sep 25 17:10:53 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:53 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ac80a10f-ee36-4310-9e95-5b0a60c5c294.temp_image.229c07f8-cf1d-416f-9e6c-4ebdd99adfe8b5sefchg.img /opt/stack/data/cinder/conversion/vol_upload_khkefvgd" returned: 0 in 0.297s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:53 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] Image conversion details: src /opt/stack/data/cinder/conversion/ac80a10f-ee36-4310-9e95-5b0a60c5c294.temp_image.229c07f8-cf1d-416f-9e6c-4ebdd99adfe8b5sefchg.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_khkefvgd {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:10:53 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 25 17:10:53 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[87803294-f195-4687-80fd-146b66225e45]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_khkefvgd {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:53 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_khkefvgd Sep 25 17:10:53 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:10:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:53 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:10:53 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:53 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_khkefvgd" returned: 0 in 0.422s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:54 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.383s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:54 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:10:54 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:10:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 28 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:10:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:10:54 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:UPDATE=18,cinder:SELECT=8,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:10:54 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:10:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Flow 'volume_create_manager' (4d1a4936-d84b-4998-8e5d-d70873d29774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:10:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22eb891e-df71-409c-9eeb-92238556c7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22eb891e-df71-409c-9eeb-92238556c7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-387455195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=659c3203-9a5b-46a5-bf74-acaf8749886a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea619f3d4c5743bf99e5fec1b1852830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:54Z,use_quota=True,user_id='8b6e22bf122b46e5bf0628596656fb5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e85b92-8105-4176-9233-75e9ee0ec3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e85b92-8105-4176-9233-75e9ee0ec3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (667520d1-f139-410a-8cf7-50cdc8d1ae9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (667520d1-f139-410a-8cf7-50cdc8d1ae9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '659c3203-9a5b-46a5-bf74-acaf8749886a', 'volume_name': 'volume-659c3203-9a5b-46a5-bf74-acaf8749886a', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe6d7f1-bbfd-44a3-9741-c76031e7de79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe6d7f1-bbfd-44a3-9741-c76031e7de79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25895e2d-df0c-4ff4-abc9-1bb3cb0077a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:54 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Volume 659c3203-9a5b-46a5-bf74-acaf8749886a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-659c3203-9a5b-46a5-bf74-acaf8749886a', 'volume_size': 1} Sep 25 17:10:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.343s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:55 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] Uploaded volume to glance image-id: 229c07f8-cf1d-416f-9e6c-4ebdd99adfe8. {{(pid=87211) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 17:10:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-88e19a49-dd17-4884-81aa-ec7392158948 req-6afe2948-b6e0-4d50-9611-082e10505197 tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.820s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-88e19a49-dd17-4884-81aa-ec7392158948 req-6afe2948-b6e0-4d50-9611-082e10505197 tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.243s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-387455195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=659c3203-9a5b-46a5-bf74-acaf8749886a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea619f3d4c5743bf99e5fec1b1852830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:54Z,use_quota=True,user_id='8b6e22bf122b46e5bf0628596656fb5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:10:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Creating volume 659c3203-9a5b-46a5-bf74-acaf8749886a {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:10:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:10:55 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:10:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-659c3203-9a5b-46a5-bf74-acaf8749886a 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:55 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-f42fbed4-120f-4b56-91ac-ba287962cc3e tempest-VolumesActionsTest-1887325160 None] Copy volume to image completed successfully. Sep 25 17:10:55 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-659c3203-9a5b-46a5-bf74-acaf8749886a 1073741824 Sep 25 17:10:55 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:55 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-88e19a49-dd17-4884-81aa-ec7392158948 req-6afe2948-b6e0-4d50-9611-082e10505197 tempest-AttachVolumeTestJSON-1624605778 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-c89b62f8-d133-433e-89b6-9a51d286c8bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86980518-8367-435f-a316-c876f3065e5c', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:10:55 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-88e19a49-dd17-4884-81aa-ec7392158948 req-6afe2948-b6e0-4d50-9611-082e10505197 tempest-AttachVolumeTestJSON-1624605778 None] attachment_update completed successfully. Sep 25 17:10:56 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-659c3203-9a5b-46a5-bf74-acaf8749886a 1073741824" returned: 0 in 0.599s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-659c3203-9a5b-46a5-bf74-acaf8749886a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:56 devstack sudo[95102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-659c3203-9a5b-46a5-bf74-acaf8749886a Sep 25 17:10:56 devstack sudo[95102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:56 devstack sudo[95102]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-659c3203-9a5b-46a5-bf74-acaf8749886a" returned: 0 in 0.280s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:10:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25895e2d-df0c-4ff4-abc9-1bb3cb0077a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-659c3203-9a5b-46a5-bf74-acaf8749886a', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2216bf0e-17ef-42cd-8423-88ca2a9ba4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:56 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Volume volume-659c3203-9a5b-46a5-bf74-acaf8749886a (659c3203-9a5b-46a5-bf74-acaf8749886a): created successfully Sep 25 17:10:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2216bf0e-17ef-42cd-8423-88ca2a9ba4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Flow 'volume_create_manager' (4d1a4936-d84b-4998-8e5d-d70873d29774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:10:56 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-eb215817-9f09-49cc-b9e7-1eb813b05a63 tempest-VolumesTransfersTest-351090479 None] Created volume successfully. Sep 25 17:10:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-60f03e96-f28d-4f32-8b60-e5bea3cf125d tempest-VolumesActionsTest-1887325160 None] Acquiring lock "cinder-ac80a10f-ee36-4310-9e95-5b0a60c5c294-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-60f03e96-f28d-4f32-8b60-e5bea3cf125d tempest-VolumesActionsTest-1887325160 None] Lock "cinder-ac80a10f-ee36-4310-9e95-5b0a60c5c294-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-60f03e96-f28d-4f32-8b60-e5bea3cf125d tempest-VolumesActionsTest-1887325160 None] Acquiring lock "cinder-quobyte-ac80a10f-ee36-4310-9e95-5b0a60c5c294" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-60f03e96-f28d-4f32-8b60-e5bea3cf125d tempest-VolumesActionsTest-1887325160 None] Lock "cinder-quobyte-ac80a10f-ee36-4310-9e95-5b0a60c5c294" acquired by "delete_volume" :: waited 0.014s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:57 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[480d53fa-bc4a-4fda-a21d-826d7ebd7f33]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-60f03e96-f28d-4f32-8b60-e5bea3cf125d tempest-VolumesActionsTest-1887325160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:57 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 Sep 25 17:10:57 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:57 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-60f03e96-f28d-4f32-8b60-e5bea3cf125d tempest-VolumesActionsTest-1887325160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294" returned: 0 in 0.433s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-60f03e96-f28d-4f32-8b60-e5bea3cf125d tempest-VolumesActionsTest-1887325160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:57 devstack sudo[95115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294 Sep 25 17:10:57 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:57 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-60f03e96-f28d-4f32-8b60-e5bea3cf125d tempest-VolumesActionsTest-1887325160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ac80a10f-ee36-4310-9e95-5b0a60c5c294" returned: 0 in 0.413s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-60f03e96-f28d-4f32-8b60-e5bea3cf125d tempest-VolumesActionsTest-1887325160 None] Lock "cinder-quobyte-ac80a10f-ee36-4310-9e95-5b0a60c5c294" released by "delete_volume" :: held 0.918s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:58 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-60f03e96-f28d-4f32-8b60-e5bea3cf125d tempest-VolumesActionsTest-1887325160 None] Created reservations ['625a4644-4fca-4f2a-9c98-ea84411e8e2a', '4d74b741-41d8-47a5-a644-9cb569cba021', '40bc2efe-f105-4d00-b9c9-2436728c7b08', 'fdd30317-2a40-40bc-aec5-d51563487cc7'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:10:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-60f03e96-f28d-4f32-8b60-e5bea3cf125d tempest-VolumesActionsTest-1887325160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-60f03e96-f28d-4f32-8b60-e5bea3cf125d tempest-VolumesActionsTest-1887325160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:58 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-60f03e96-f28d-4f32-8b60-e5bea3cf125d tempest-VolumesActionsTest-1887325160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:58 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-60f03e96-f28d-4f32-8b60-e5bea3cf125d tempest-VolumesActionsTest-1887325160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-60f03e96-f28d-4f32-8b60-e5bea3cf125d tempest-VolumesActionsTest-1887325160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-60f03e96-f28d-4f32-8b60-e5bea3cf125d tempest-VolumesActionsTest-1887325160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:58 devstack sudo[95122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:10:58 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:58 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-1462ea61-b51f-48c3-80ca-02e06e4a6146 req-1e2939d3-d1b7-4b02-ac86-e58bb065413c tempest-AttachVolumeShelveTestJSON-2117417879 None] No connector for attachment f865980e-54a3-4c8d-8032-909edf6e006c; skipping storage backend terminate_connection call. {{(pid=87211) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 25 17:10:58 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-1462ea61-b51f-48c3-80ca-02e06e4a6146 req-1e2939d3-d1b7-4b02-ac86-e58bb065413c tempest-AttachVolumeShelveTestJSON-2117417879 None] Deleting attachment f865980e-54a3-4c8d-8032-909edf6e006c. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:10:58 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-60f03e96-f28d-4f32-8b60-e5bea3cf125d tempest-VolumesActionsTest-1887325160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.314s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:58 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-60f03e96-f28d-4f32-8b60-e5bea3cf125d tempest-VolumesActionsTest-1887325160 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:10:58 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-60f03e96-f28d-4f32-8b60-e5bea3cf125d tempest-VolumesActionsTest-1887325160 None] Deleted volume successfully. Sep 25 17:10:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-60f03e96-f28d-4f32-8b60-e5bea3cf125d tempest-VolumesActionsTest-1887325160 None] Lock "cinder-ac80a10f-ee36-4310-9e95-5b0a60c5c294-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:58 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-05d0ad1b-01f0-4656-9358-19e880a0ad17 tempest-VolumesTransfersTest-1321726819 None] Transfer volume completed successfully. Sep 25 17:10:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6853a36c-4d10-40df-baa3-505cf6442000 tempest-VolumesTransfersTest-1297756719 None] Acquiring lock "cinder-659c3203-9a5b-46a5-bf74-acaf8749886a-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6853a36c-4d10-40df-baa3-505cf6442000 tempest-VolumesTransfersTest-1297756719 None] Lock "cinder-659c3203-9a5b-46a5-bf74-acaf8749886a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6853a36c-4d10-40df-baa3-505cf6442000 tempest-VolumesTransfersTest-1297756719 None] Acquiring lock "cinder-quobyte-659c3203-9a5b-46a5-bf74-acaf8749886a" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6853a36c-4d10-40df-baa3-505cf6442000 tempest-VolumesTransfersTest-1297756719 None] Lock "cinder-quobyte-659c3203-9a5b-46a5-bf74-acaf8749886a" acquired by "delete_volume" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:59 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[1540a586-3fa9-473f-bc91-c9d9f2f57140]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6853a36c-4d10-40df-baa3-505cf6442000 tempest-VolumesTransfersTest-1297756719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-659c3203-9a5b-46a5-bf74-acaf8749886a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:59 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-659c3203-9a5b-46a5-bf74-acaf8749886a Sep 25 17:10:59 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:59 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6853a36c-4d10-40df-baa3-505cf6442000 tempest-VolumesTransfersTest-1297756719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-659c3203-9a5b-46a5-bf74-acaf8749886a" returned: 0 in 0.497s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6853a36c-4d10-40df-baa3-505cf6442000 tempest-VolumesTransfersTest-1297756719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-659c3203-9a5b-46a5-bf74-acaf8749886a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:59 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-659c3203-9a5b-46a5-bf74-acaf8749886a Sep 25 17:10:59 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:00 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6853a36c-4d10-40df-baa3-505cf6442000 tempest-VolumesTransfersTest-1297756719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-659c3203-9a5b-46a5-bf74-acaf8749886a" returned: 0 in 0.395s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6853a36c-4d10-40df-baa3-505cf6442000 tempest-VolumesTransfersTest-1297756719 None] Lock "cinder-quobyte-659c3203-9a5b-46a5-bf74-acaf8749886a" released by "delete_volume" :: held 0.965s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:00 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-6853a36c-4d10-40df-baa3-505cf6442000 tempest-VolumesTransfersTest-1297756719 None] Created reservations ['d6442680-02c2-46a9-9345-811f3d88683b', 'b8559aaa-baf6-465c-a716-9b19416cf55d', '75720e06-690f-4022-b579-def9aa9ff832', 'f2862b70-82d7-4c77-a45b-07fee6384a24'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:11:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6853a36c-4d10-40df-baa3-505cf6442000 tempest-VolumesTransfersTest-1297756719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6853a36c-4d10-40df-baa3-505cf6442000 tempest-VolumesTransfersTest-1297756719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:00 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6853a36c-4d10-40df-baa3-505cf6442000 tempest-VolumesTransfersTest-1297756719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:00 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6853a36c-4d10-40df-baa3-505cf6442000 tempest-VolumesTransfersTest-1297756719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6853a36c-4d10-40df-baa3-505cf6442000 tempest-VolumesTransfersTest-1297756719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6853a36c-4d10-40df-baa3-505cf6442000 tempest-VolumesTransfersTest-1297756719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:00 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:11:00 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:00 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6853a36c-4d10-40df-baa3-505cf6442000 tempest-VolumesTransfersTest-1297756719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.269s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:00 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-6853a36c-4d10-40df-baa3-505cf6442000 tempest-VolumesTransfersTest-1297756719 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:11:00 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-6853a36c-4d10-40df-baa3-505cf6442000 tempest-VolumesTransfersTest-1297756719 None] Deleted volume successfully. Sep 25 17:11:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6853a36c-4d10-40df-baa3-505cf6442000 tempest-VolumesTransfersTest-1297756719 None] Lock "cinder-659c3203-9a5b-46a5-bf74-acaf8749886a-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:02 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:11:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Flow 'volume_create_manager' (6f0cae31-f4f7-4bdc-868f-b9f26562d6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca5691a-9ef8-4d19-950a-27ba10ec5dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca5691a-9ef8-4d19-950a-27ba10ec5dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-249382588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45144b22-ac24-47f2-8cae-834945efbdfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea619f3d4c5743bf99e5fec1b1852830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:02Z,use_quota=True,user_id='8b6e22bf122b46e5bf0628596656fb5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae87156-e231-4d23-bfd6-07ad2ceecafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae87156-e231-4d23-bfd6-07ad2ceecafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b4490a7-79e0-44f6-b08d-e3e573d4f025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b4490a7-79e0-44f6-b08d-e3e573d4f025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45144b22-ac24-47f2-8cae-834945efbdfd', 'volume_name': 'volume-45144b22-ac24-47f2-8cae-834945efbdfd', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8589006e-0bf6-495b-9ad9-7636c2d97e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8589006e-0bf6-495b-9ad9-7636c2d97e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60fd986b-3fb9-438b-90f2-bdceeb94d425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:02 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Volume 45144b22-ac24-47f2-8cae-834945efbdfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45144b22-ac24-47f2-8cae-834945efbdfd', 'volume_size': 1} Sep 25 17:11:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-249382588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45144b22-ac24-47f2-8cae-834945efbdfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea619f3d4c5743bf99e5fec1b1852830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:02Z,use_quota=True,user_id='8b6e22bf122b46e5bf0628596656fb5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:11:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Creating volume 45144b22-ac24-47f2-8cae-834945efbdfd {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:11:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:11:02 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:11:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45144b22-ac24-47f2-8cae-834945efbdfd 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:02 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45144b22-ac24-47f2-8cae-834945efbdfd 1073741824 Sep 25 17:11:02 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:03 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45144b22-ac24-47f2-8cae-834945efbdfd 1073741824" returned: 0 in 0.909s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45144b22-ac24-47f2-8cae-834945efbdfd {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:03 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45144b22-ac24-47f2-8cae-834945efbdfd Sep 25 17:11:03 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:03 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45144b22-ac24-47f2-8cae-834945efbdfd" returned: 0 in 0.433s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:11:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60fd986b-3fb9-438b-90f2-bdceeb94d425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45144b22-ac24-47f2-8cae-834945efbdfd', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2e050b-f507-4d20-a0b6-719e38a5d756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:04 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Volume volume-45144b22-ac24-47f2-8cae-834945efbdfd (45144b22-ac24-47f2-8cae-834945efbdfd): created successfully Sep 25 17:11:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2e050b-f507-4d20-a0b6-719e38a5d756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Flow 'volume_create_manager' (6f0cae31-f4f7-4bdc-868f-b9f26562d6c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:04 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-0ec238aa-078b-4b76-aeab-36ea41425fde tempest-VolumesTransfersTest-351090479 None] Created volume successfully. Sep 25 17:11:05 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a295a47c-ae53-47e1-948d-2d639f9a8da7 tempest-VolumesTransfersTest-1297756719 None] Acquiring lock "cinder-45144b22-ac24-47f2-8cae-834945efbdfd-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:05 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a295a47c-ae53-47e1-948d-2d639f9a8da7 tempest-VolumesTransfersTest-1297756719 None] Lock "cinder-45144b22-ac24-47f2-8cae-834945efbdfd-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:05 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a295a47c-ae53-47e1-948d-2d639f9a8da7 tempest-VolumesTransfersTest-1297756719 None] Acquiring lock "cinder-quobyte-45144b22-ac24-47f2-8cae-834945efbdfd" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:05 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a295a47c-ae53-47e1-948d-2d639f9a8da7 tempest-VolumesTransfersTest-1297756719 None] Lock "cinder-quobyte-45144b22-ac24-47f2-8cae-834945efbdfd" acquired by "delete_volume" :: waited 0.035s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:05 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8abc81-559c-4fda-8b00-09077d7c750d]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a295a47c-ae53-47e1-948d-2d639f9a8da7 tempest-VolumesTransfersTest-1297756719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45144b22-ac24-47f2-8cae-834945efbdfd {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:05 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45144b22-ac24-47f2-8cae-834945efbdfd Sep 25 17:11:05 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:06 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a295a47c-ae53-47e1-948d-2d639f9a8da7 tempest-VolumesTransfersTest-1297756719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45144b22-ac24-47f2-8cae-834945efbdfd" returned: 0 in 0.822s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a295a47c-ae53-47e1-948d-2d639f9a8da7 tempest-VolumesTransfersTest-1297756719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45144b22-ac24-47f2-8cae-834945efbdfd {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:06 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45144b22-ac24-47f2-8cae-834945efbdfd Sep 25 17:11:06 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:06 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a295a47c-ae53-47e1-948d-2d639f9a8da7 tempest-VolumesTransfersTest-1297756719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45144b22-ac24-47f2-8cae-834945efbdfd" returned: 0 in 0.792s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:06 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a295a47c-ae53-47e1-948d-2d639f9a8da7 tempest-VolumesTransfersTest-1297756719 None] Lock "cinder-quobyte-45144b22-ac24-47f2-8cae-834945efbdfd" released by "delete_volume" :: held 1.684s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:07 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-a295a47c-ae53-47e1-948d-2d639f9a8da7 tempest-VolumesTransfersTest-1297756719 None] Created reservations ['cac10ab8-69eb-4d0b-b011-ad64a2a42df0', 'a68a1899-baa3-4fc9-a60e-d818b9c30595', '3c0ba098-6a56-4437-bbac-9ea1b429554b', '9ed8ab64-4a06-4fa6-977b-9154df118af5'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:11:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a295a47c-ae53-47e1-948d-2d639f9a8da7 tempest-VolumesTransfersTest-1297756719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a295a47c-ae53-47e1-948d-2d639f9a8da7 tempest-VolumesTransfersTest-1297756719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a295a47c-ae53-47e1-948d-2d639f9a8da7 tempest-VolumesTransfersTest-1297756719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a295a47c-ae53-47e1-948d-2d639f9a8da7 tempest-VolumesTransfersTest-1297756719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a295a47c-ae53-47e1-948d-2d639f9a8da7 tempest-VolumesTransfersTest-1297756719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a295a47c-ae53-47e1-948d-2d639f9a8da7 tempest-VolumesTransfersTest-1297756719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:07 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:11:07 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:07 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a295a47c-ae53-47e1-948d-2d639f9a8da7 tempest-VolumesTransfersTest-1297756719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.527s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:07 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-a295a47c-ae53-47e1-948d-2d639f9a8da7 tempest-VolumesTransfersTest-1297756719 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:11:07 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-a295a47c-ae53-47e1-948d-2d639f9a8da7 tempest-VolumesTransfersTest-1297756719 None] Deleted volume successfully. Sep 25 17:11:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a295a47c-ae53-47e1-948d-2d639f9a8da7 tempest-VolumesTransfersTest-1297756719 None] Lock "cinder-45144b22-ac24-47f2-8cae-834945efbdfd-delete_volume" released by "delete_volume" :: held 2.824s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:16 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:11:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Flow 'volume_create_manager' (7e78a249-d4d6-4306-89d0-1bea4a9600ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66fe30f0-c5b5-467e-9793-b4543c980901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66fe30f0-c5b5-467e-9793-b4543c980901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1317521973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4f6e65a-eaae-4400-a0bc-f98a8cde5fac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d025d00997f47cf905241c3a80c081c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:17Z,use_quota=True,user_id='8b0a0f3b3b8b4f40b345e0dcc5e5b613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba99503-ab4f-4367-89d1-3af8313b873a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba99503-ab4f-4367-89d1-3af8313b873a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d525978d-ba68-4c30-9be5-f02a7ab79a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d525978d-ba68-4c30-9be5-f02a7ab79a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4f6e65a-eaae-4400-a0bc-f98a8cde5fac', 'volume_name': 'volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e858d1b-0b17-472d-9d84-6b4020f25bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e858d1b-0b17-472d-9d84-6b4020f25bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad4856ab-d2c2-44ed-9fca-4b800910931c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:16 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Volume b4f6e65a-eaae-4400-a0bc-f98a8cde5fac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac', 'volume_size': 1} Sep 25 17:11:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1317521973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4f6e65a-eaae-4400-a0bc-f98a8cde5fac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d025d00997f47cf905241c3a80c081c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:17Z,use_quota=True,user_id='8b0a0f3b3b8b4f40b345e0dcc5e5b613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:11:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Creating volume b4f6e65a-eaae-4400-a0bc-f98a8cde5fac {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:11:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:11:16 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:11:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:16 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac 1073741824 Sep 25 17:11:16 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:17 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac 1073741824" returned: 0 in 0.816s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:17 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac Sep 25 17:11:17 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:18 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac" returned: 0 in 0.339s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:18 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:11:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:18 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad4856ab-d2c2-44ed-9fca-4b800910931c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:18 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63223e2c-ed84-45ea-813d-206343a4338f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:18 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Volume volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac (b4f6e65a-eaae-4400-a0bc-f98a8cde5fac): created successfully Sep 25 17:11:18 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63223e2c-ed84-45ea-813d-206343a4338f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:18 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Flow 'volume_create_manager' (7e78a249-d4d6-4306-89d0-1bea4a9600ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:18 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-ce978225-4c73-455f-9e32-a5ebf1928b18 tempest-VolumesCloneTest-808701494 None] Created volume successfully. Sep 25 17:11:19 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:11:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Flow 'volume_create_manager' (8b1696cf-875c-4731-bfed-42ea252d2a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a58060-4030-47f7-8f57-70d8e80acce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a58060-4030-47f7-8f57-70d8e80acce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1309691968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ef5477-1bdf-491e-bd4d-13f21940ab92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d025d00997f47cf905241c3a80c081c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=b4f6e65a-eaae-4400-a0bc-f98a8cde5fac,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:19Z,use_quota=True,user_id='8b0a0f3b3b8b4f40b345e0dcc5e5b613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc22cf60-02ac-4b1b-b7f6-818aee39fcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc22cf60-02ac-4b1b-b7f6-818aee39fcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3eacb7-9b4e-4680-95f0-192ae1a3c120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3eacb7-9b4e-4680-95f0-192ae1a3c120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f0ef5477-1bdf-491e-bd4d-13f21940ab92', 'volume_name': 'volume-f0ef5477-1bdf-491e-bd4d-13f21940ab92', 'volume_size': 2, 'source_volid': 'b4f6e65a-eaae-4400-a0bc-f98a8cde5fac', 'source_volstatus': 'available'}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30df7303-e7fd-4b7d-9e77-c7a0d6e5ba8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30df7303-e7fd-4b7d-9e77-c7a0d6e5ba8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949cf82f-0ad6-4e3f-9dae-357353948b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:19 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Volume f0ef5477-1bdf-491e-bd4d-13f21940ab92: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f0ef5477-1bdf-491e-bd4d-13f21940ab92', 'volume_size': 2, 'source_volid': 'b4f6e65a-eaae-4400-a0bc-f98a8cde5fac', 'source_volstatus': 'available'} Sep 25 17:11:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:19 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Cloning volume b4f6e65a-eaae-4400-a0bc-f98a8cde5fac to volume f0ef5477-1bdf-491e-bd4d-13f21940ab92 Sep 25 17:11:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Creating offline snapshot b6808e71-908b-485a-b995-da5b584da8fa of volume b4f6e65a-eaae-4400-a0bc-f98a8cde5fac {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:11:19 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb2573b-c8f5-4a9c-8f61-a0721ef84439]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:19 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac Sep 25 17:11:19 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:20 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac" returned: 0 in 0.491s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:20 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa 1G Sep 25 17:11:20 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:20 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa 1G" returned: 0 in 0.600s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:20 devstack sudo[95879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa Sep 25 17:11:20 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:21 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:11:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Flow 'volume_create_manager' (a1711457-db3b-4200-8e61-8af666b1ea83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf77c09-f184-43c0-86fa-6c6f7f515885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf77c09-f184-43c0-86fa-6c6f7f515885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2066003710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49caf7f6-61f4-433d-a96e-f2a2d7ba39c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a8ad6d4913749f6b63266744fb6f5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:21Z,use_quota=True,user_id='83d7ab2ec51f46439dc7b1447360fc00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdf3ea6-7b98-4570-9e16-376d136a69b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdf3ea6-7b98-4570-9e16-376d136a69b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9bda45a-8ea7-4186-be0f-e1092ad5e57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:21 devstack cinder-volume[87211]: DEBUG cinder.image.glance [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Creating Keystone auth plugin from conf {{(pid=87211) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 17:11:21 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa" returned: 0 in 0.464s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:21 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa is being set with open permissions: ugo+rw Sep 25 17:11:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:21 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa Sep 25 17:11:21 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9bda45a-8ea7-4186-be0f-e1092ad5e57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '49caf7f6-61f4-433d-a96e-f2a2d7ba39c0', 'volume_name': 'volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0', 'volume_size': 1, 'image_id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'acaf9a5e9cfc4af3b32eda10c91e30fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'created_at': datetime.datetime(2026, 9, 25, 14, 58, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5fc5076-b875-47ab-a9de-1e72ff277743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5fc5076-b875-47ab-a9de-1e72ff277743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b48ba1b9-7823-482f-97d1-d61f77a63f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:21 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Volume 49caf7f6-61f4-433d-a96e-f2a2d7ba39c0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0', 'volume_size': 1, 'image_id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'acaf9a5e9cfc4af3b32eda10c91e30fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'created_at': datetime.datetime(2026, 9, 25, 14, 58, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 17:11:21 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Trying to clone 49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 from image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}]). {{(pid=87211) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 17:11:21 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa" returned: 0 in 0.315s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:21 devstack sudo[95887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.info Sep 25 17:11:21 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:21 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_idfx10n8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 17:11:21 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Image download 20.69 MB at 20.69 MB/s Sep 25 17:11:21 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2881f4-040a-4619-a2cb-11cdc42544a1]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_idfx10n8devstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:22 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.info" returned: 0 in 0.369s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:22 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.info is being set with open permissions: ugo+rw Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:22 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_idfx10n8devstack@QuobyteHD Sep 25 17:11:22 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.info Sep 25 17:11:22 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:22 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:22 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.info" returned: 0 in 0.248s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:22 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Acquiring lock "cinder-quobyte-f0ef5477-1bdf-491e-bd4d-13f21940ab92" by "_copy_volume_from_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_idfx10n8devstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Temporary image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 is fetched for user 83d7ab2ec51f46439dc7b1447360fc00. {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Lock "cinder-quobyte-f0ef5477-1bdf-491e-bd4d-13f21940ab92" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] snapshot: b6808e71-908b-485a-b995-da5b584da8fa, volume: f0ef5477-1bdf-491e-bd4d-13f21940ab92, {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff969ff3-475b-4147-b5ca-d4d26d768c8e]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3e10bc-a254-4c06-8ebb-b9726a0cb28a]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_idfx10n8devstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:22 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa Sep 25 17:11:22 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:22 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_idfx10n8devstack@QuobyteHD Sep 25 17:11:22 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:22 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_idfx10n8devstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:22 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa" returned: 0 in 0.406s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[467275fd-d726-4426-b4a6-507d5463d769]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:22 devstack sudo[95933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac Sep 25 17:11:22 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:23 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac" returned: 0 in 0.417s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] will copy from snapshot at /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:11:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Creating direct copy from snapshot {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:11:23 devstack cinder-volume[87211]: DEBUG cinder.utils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Path /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f0ef5477-1bdf-491e-bd4d-13f21940ab92 not found in is_blk_device check {{(pid=87211) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:11:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f0ef5477-1bdf-491e-bd4d-13f21940ab92 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:23 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f0ef5477-1bdf-491e-bd4d-13f21940ab92 Sep 25 17:11:23 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:31 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f0ef5477-1bdf-491e-bd4d-13f21940ab92" returned: 0 in 8.013s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:31 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Image conversion details: src /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac, size 1024.00 MB, duration 8.01 sec, destination /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f0ef5477-1bdf-491e-bd4d-13f21940ab92 {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:11:31 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Converted 1024.00 MB image at 127.77 MB/s Sep 25 17:11:31 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f0ef5477-1bdf-491e-bd4d-13f21940ab92 is being set with open permissions: ugo+rw Sep 25 17:11:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f0ef5477-1bdf-491e-bd4d-13f21940ab92 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:31 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f0ef5477-1bdf-491e-bd4d-13f21940ab92 Sep 25 17:11:31 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:31 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f0ef5477-1bdf-491e-bd4d-13f21940ab92" returned: 0 in 0.268s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:31 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Lock "cinder-quobyte-f0ef5477-1bdf-491e-bd4d-13f21940ab92" released by "_copy_volume_from_snapshot" :: held 9.186s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:31 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Acquiring lock "cinder-quobyte-b6808e71-908b-485a-b995-da5b584da8fa" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:31 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Lock "cinder-quobyte-b6808e71-908b-485a-b995-da5b584da8fa" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:31 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Deleting offline snapshot b6808e71-908b-485a-b995-da5b584da8fa of volume b4f6e65a-eaae-4400-a0bc-f98a8cde5fac {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:11:31 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] snapshot_file for this snap is: volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:11:31 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6562ee47-59de-47e8-99db-93b5a2135deb]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:31 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa Sep 25 17:11:31 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:31 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa" returned: 0 in 0.375s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:31 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:11:31 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0624de0-29d2-485d-91db-7bdeddfd1604]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:32 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac Sep 25 17:11:32 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:32 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:UPDATE=39,cinder:SELECT=32,cinder:INSERT=10,cinder:DELETE=5 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:11:32 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac" returned: 0 in 0.520s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:32 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa Sep 25 17:11:32 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:32 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa" returned: 0 in 0.335s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:32 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa Sep 25 17:11:32 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:33 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac.b6808e71-908b-485a-b995-da5b584da8fa" returned: 0 in 0.238s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Lock "cinder-quobyte-b6808e71-908b-485a-b995-da5b584da8fa" released by "_delete_snapshot" :: held 1.568s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.488s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.383s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2066003710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49caf7f6-61f4-433d-a96e-f2a2d7ba39c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a8ad6d4913749f6b63266744fb6f5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:21Z,use_quota=True,user_id='83d7ab2ec51f46439dc7b1447360fc00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Creating volume 49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:11:33 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:33 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 1073741824 Sep 25 17:11:33 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949cf82f-0ad6-4e3f-9dae-357353948b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0ef5477-1bdf-491e-bd4d-13f21940ab92', 'volume_size': 2, 'source_volid': 'b4f6e65a-eaae-4400-a0bc-f98a8cde5fac', 'source_volstatus': 'available'}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7563bce0-6215-4d1c-8543-a2795657c5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:33 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Volume volume-f0ef5477-1bdf-491e-bd4d-13f21940ab92 (f0ef5477-1bdf-491e-bd4d-13f21940ab92): created successfully Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7563bce0-6215-4d1c-8543-a2795657c5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Flow 'volume_create_manager' (8b1696cf-875c-4731-bfed-42ea252d2a41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:33 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-e90c305a-507d-4b33-aa9a-7a602881772b tempest-VolumesCloneTest-808701494 None] Created volume successfully. Sep 25 17:11:33 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 1073741824" returned: 0 in 0.421s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:33 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 Sep 25 17:11:33 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:33 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0" returned: 0 in 0.258s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Attempting download of 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}])) to volume 49caf7f6-61f4-433d-a96e-f2a2d7ba39c0. {{(pid=87211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[7509e5db-07d7-4847-8ccd-129ce7604795]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_vjg4ntnb {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:34 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_vjg4ntnb Sep 25 17:11:34 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b2cf0bf6-bb56-419d-b443-e31e23452b0f tempest-VolumesCloneTest-808701494 None] Acquiring lock "cinder-f0ef5477-1bdf-491e-bd4d-13f21940ab92-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b2cf0bf6-bb56-419d-b443-e31e23452b0f tempest-VolumesCloneTest-808701494 None] Lock "cinder-f0ef5477-1bdf-491e-bd4d-13f21940ab92-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b2cf0bf6-bb56-419d-b443-e31e23452b0f tempest-VolumesCloneTest-808701494 None] Acquiring lock "cinder-quobyte-f0ef5477-1bdf-491e-bd4d-13f21940ab92" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b2cf0bf6-bb56-419d-b443-e31e23452b0f tempest-VolumesCloneTest-808701494 None] Lock "cinder-quobyte-f0ef5477-1bdf-491e-bd4d-13f21940ab92" acquired by "delete_volume" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:34 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_vjg4ntnb" returned: 0 in 0.357s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_vjg4ntnb {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:34 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c45f7b0-87eb-4e18-860e-bf2d5bb5e42d]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2cf0bf6-bb56-419d-b443-e31e23452b0f tempest-VolumesCloneTest-808701494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f0ef5477-1bdf-491e-bd4d-13f21940ab92 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:34 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_vjg4ntnb Sep 25 17:11:34 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:34 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f0ef5477-1bdf-491e-bd4d-13f21940ab92 Sep 25 17:11:34 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:34 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_vjg4ntnb" returned: 1 in 0.314s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_vjg4ntnb' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:11:34 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9d86b5-34fc-4c3c-9777-587539e51a17]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_idfx10n8devstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:34 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2cf0bf6-bb56-419d-b443-e31e23452b0f tempest-VolumesCloneTest-808701494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f0ef5477-1bdf-491e-bd4d-13f21940ab92" returned: 0 in 0.375s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2cf0bf6-bb56-419d-b443-e31e23452b0f tempest-VolumesCloneTest-808701494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f0ef5477-1bdf-491e-bd4d-13f21940ab92 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:34 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f0ef5477-1bdf-491e-bd4d-13f21940ab92 Sep 25 17:11:34 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:34 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_idfx10n8devstack@QuobyteHD Sep 25 17:11:34 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:34 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2cf0bf6-bb56-419d-b443-e31e23452b0f tempest-VolumesCloneTest-808701494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f0ef5477-1bdf-491e-bd4d-13f21940ab92" returned: 0 in 0.251s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:34 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_idfx10n8devstack@QuobyteHD" returned: 0 in 0.337s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:34 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 was qcow2, converting to qcow2 {{(pid=87211) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 17:11:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_idfx10n8devstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b2cf0bf6-bb56-419d-b443-e31e23452b0f tempest-VolumesCloneTest-808701494 None] Lock "cinder-quobyte-f0ef5477-1bdf-491e-bd4d-13f21940ab92" released by "delete_volume" :: held 0.688s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:34 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_idfx10n8devstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 Sep 25 17:11:34 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:35 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-b2cf0bf6-bb56-419d-b443-e31e23452b0f tempest-VolumesCloneTest-808701494 None] Created reservations ['02d16e46-9663-4499-a8ec-bfb16e30c7b1', 'effa60cf-08de-4a66-91df-0c1079ccd0d5', 'c922dda2-d691-4f5d-b252-07fbedd0d439', 'd85dfcdf-b5da-4b2a-9aec-1d591fbc5dd2'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:11:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b2cf0bf6-bb56-419d-b443-e31e23452b0f tempest-VolumesCloneTest-808701494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b2cf0bf6-bb56-419d-b443-e31e23452b0f tempest-VolumesCloneTest-808701494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:35 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b2cf0bf6-bb56-419d-b443-e31e23452b0f tempest-VolumesCloneTest-808701494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:35 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b2cf0bf6-bb56-419d-b443-e31e23452b0f tempest-VolumesCloneTest-808701494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b2cf0bf6-bb56-419d-b443-e31e23452b0f tempest-VolumesCloneTest-808701494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2cf0bf6-bb56-419d-b443-e31e23452b0f tempest-VolumesCloneTest-808701494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:35 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:11:35 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:35 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2cf0bf6-bb56-419d-b443-e31e23452b0f tempest-VolumesCloneTest-808701494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.279s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:35 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-b2cf0bf6-bb56-419d-b443-e31e23452b0f tempest-VolumesCloneTest-808701494 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:11:35 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b2cf0bf6-bb56-419d-b443-e31e23452b0f tempest-VolumesCloneTest-808701494 None] Deleted volume successfully. Sep 25 17:11:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b2cf0bf6-bb56-419d-b443-e31e23452b0f tempest-VolumesCloneTest-808701494 None] Lock "cinder-f0ef5477-1bdf-491e-bd4d-13f21940ab92-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0af703b2-72a9-4ff5-aca9-06dc67b2a723 tempest-VolumesCloneTest-808701494 None] Acquiring lock "cinder-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0af703b2-72a9-4ff5-aca9-06dc67b2a723 tempest-VolumesCloneTest-808701494 None] Lock "cinder-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0af703b2-72a9-4ff5-aca9-06dc67b2a723 tempest-VolumesCloneTest-808701494 None] Acquiring lock "cinder-quobyte-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0af703b2-72a9-4ff5-aca9-06dc67b2a723 tempest-VolumesCloneTest-808701494 None] Lock "cinder-quobyte-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac" acquired by "delete_volume" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:35 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8118cb3-f9c0-4314-8cca-c5dbc8d3d6d2]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0af703b2-72a9-4ff5-aca9-06dc67b2a723 tempest-VolumesCloneTest-808701494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:35 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac Sep 25 17:11:35 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:36 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0af703b2-72a9-4ff5-aca9-06dc67b2a723 tempest-VolumesCloneTest-808701494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac" returned: 0 in 0.457s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0af703b2-72a9-4ff5-aca9-06dc67b2a723 tempest-VolumesCloneTest-808701494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:36 devstack sudo[96065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac Sep 25 17:11:36 devstack sudo[96065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:36 devstack sudo[96065]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0af703b2-72a9-4ff5-aca9-06dc67b2a723 tempest-VolumesCloneTest-808701494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac" returned: 0 in 0.284s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0af703b2-72a9-4ff5-aca9-06dc67b2a723 tempest-VolumesCloneTest-808701494 None] Lock "cinder-quobyte-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac" released by "delete_volume" :: held 0.812s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:36 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-0af703b2-72a9-4ff5-aca9-06dc67b2a723 tempest-VolumesCloneTest-808701494 None] Created reservations ['4f5d54fb-9c93-407b-b74a-5da080db0bb6', '6e51a5c9-7ed3-4334-a8c3-2cc3221ed3c3', '9e8349de-34a4-485c-bda5-0d60d8aae836', 'a962cba3-472a-4143-85de-9c21ec1d3cf4'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:11:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0af703b2-72a9-4ff5-aca9-06dc67b2a723 tempest-VolumesCloneTest-808701494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0af703b2-72a9-4ff5-aca9-06dc67b2a723 tempest-VolumesCloneTest-808701494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0af703b2-72a9-4ff5-aca9-06dc67b2a723 tempest-VolumesCloneTest-808701494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0af703b2-72a9-4ff5-aca9-06dc67b2a723 tempest-VolumesCloneTest-808701494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0af703b2-72a9-4ff5-aca9-06dc67b2a723 tempest-VolumesCloneTest-808701494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0af703b2-72a9-4ff5-aca9-06dc67b2a723 tempest-VolumesCloneTest-808701494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:36 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:11:36 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:36 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0af703b2-72a9-4ff5-aca9-06dc67b2a723 tempest-VolumesCloneTest-808701494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.311s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:36 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-0af703b2-72a9-4ff5-aca9-06dc67b2a723 tempest-VolumesCloneTest-808701494 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:11:36 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-0af703b2-72a9-4ff5-aca9-06dc67b2a723 tempest-VolumesCloneTest-808701494 None] Deleted volume successfully. Sep 25 17:11:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0af703b2-72a9-4ff5-aca9-06dc67b2a723 tempest-VolumesCloneTest-808701494 None] Lock "cinder-b4f6e65a-eaae-4400-a0bc-f98a8cde5fac-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:37 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_idfx10n8devstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0" returned: 0 in 2.166s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:37 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_idfx10n8devstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:11:37 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Converted 112.00 MB image at 51.66 MB/s Sep 25 17:11:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:37 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 1G Sep 25 17:11:37 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:37 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 1G" returned: 0 in 0.387s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:37 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Downloaded image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}])) to volume 49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 successfully. {{(pid=87211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 17:11:37 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Temporary image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 for user 83d7ab2ec51f46439dc7b1447360fc00 is deleted. {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 17:11:37 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Marking volume 49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 as bootable. {{(pid=87211) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 17:11:37 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Copying metadata from image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 to 49caf7f6-61f4-433d-a96e-f2a2d7ba39c0. {{(pid=87211) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 17:11:37 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Creating volume glance metadata for volume 49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 backed by image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87211) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 17:11:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b48ba1b9-7823-482f-97d1-d61f77a63f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0', 'volume_size': 1, 'image_id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'acaf9a5e9cfc4af3b32eda10c91e30fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'created_at': datetime.datetime(2026, 9, 25, 14, 58, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57d27159-bb14-47a8-a907-4704ed425d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:37 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Volume volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 (49caf7f6-61f4-433d-a96e-f2a2d7ba39c0): created successfully Sep 25 17:11:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57d27159-bb14-47a8-a907-4704ed425d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Flow 'volume_create_manager' (a1711457-db3b-4200-8e61-8af666b1ea83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:37 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-9a468ad7-0f01-4961-acb5-ef7b8b863df0 tempest-VolumesExtendTest-1243595684 None] Created volume successfully. Sep 25 17:11:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3cd4e269-10c4-4477-abcb-e499ccbc90e5 tempest-VolumesExtendTest-1243595684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3cd4e269-10c4-4477-abcb-e499ccbc90e5 tempest-VolumesExtendTest-1243595684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:38 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae2a836-161e-44be-b29b-c0abae911e2a]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3cd4e269-10c4-4477-abcb-e499ccbc90e5 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:38 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 Sep 25 17:11:38 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:39 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3cd4e269-10c4-4477-abcb-e499ccbc90e5 tempest-VolumesExtendTest-1243595684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0" returned: 0 in 0.425s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3cd4e269-10c4-4477-abcb-e499ccbc90e5 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 2G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3cd4e269-10c4-4477-abcb-e499ccbc90e5 tempest-VolumesExtendTest-1243595684 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 2G" returned: 0 in 0.103s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3cd4e269-10c4-4477-abcb-e499ccbc90e5 tempest-VolumesExtendTest-1243595684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.558s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:39 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=70,cinder:UPDATE=69,cinder:DELETE=5,cinder:INSERT=20 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:11:39 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-3cd4e269-10c4-4477-abcb-e499ccbc90e5 tempest-VolumesExtendTest-1243595684 None] Extend volume completed successfully. Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eba69c46-1218-413b-b41a-df97ebd0dc49 tempest-VolumesExtendTest-1243595684 None] Acquiring lock "cinder-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eba69c46-1218-413b-b41a-df97ebd0dc49 tempest-VolumesExtendTest-1243595684 None] Lock "cinder-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eba69c46-1218-413b-b41a-df97ebd0dc49 tempest-VolumesExtendTest-1243595684 None] Acquiring lock "cinder-quobyte-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eba69c46-1218-413b-b41a-df97ebd0dc49 tempest-VolumesExtendTest-1243595684 None] Lock "cinder-quobyte-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0" acquired by "delete_volume" :: waited 0.016s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6201017c-68e7-4f8d-b05e-93efb113c4fe]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eba69c46-1218-413b-b41a-df97ebd0dc49 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:40 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 Sep 25 17:11:40 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Flow 'volume_create_manager' (b4b32303-2199-4d02-8164-95730b32acbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18ff269-d4b8-453e-acdd-6fc1194d4580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18ff269-d4b8-453e-acdd-6fc1194d4580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-355989059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a54981f-6847-4525-9b4b-75678e9fca9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='218336bce66c4e1eb51cc6065b2244da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:41Z,use_quota=True,user_id='eca0e6d513ba4550a437c33a4971f32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3e3d92f-46b4-4c31-ac75-fffdbf5dd947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3e3d92f-46b4-4c31-ac75-fffdbf5dd947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67bb78d-ccc2-45b9-a0fc-478bf97c977d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67bb78d-ccc2-45b9-a0fc-478bf97c977d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a54981f-6847-4525-9b4b-75678e9fca9c', 'volume_name': 'volume-2a54981f-6847-4525-9b4b-75678e9fca9c', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480021b0-e8aa-488e-91e0-9bae483c15b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480021b0-e8aa-488e-91e0-9bae483c15b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3cdce1c-67e4-4cd4-96b3-43321fdaea50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:40 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Volume 2a54981f-6847-4525-9b4b-75678e9fca9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a54981f-6847-4525-9b4b-75678e9fca9c', 'volume_size': 1} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-355989059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a54981f-6847-4525-9b4b-75678e9fca9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='218336bce66c4e1eb51cc6065b2244da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:41Z,use_quota=True,user_id='eca0e6d513ba4550a437c33a4971f32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Creating volume 2a54981f-6847-4525-9b4b-75678e9fca9c {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:11:40 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2a54981f-6847-4525-9b4b-75678e9fca9c 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:40 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2a54981f-6847-4525-9b4b-75678e9fca9c 1073741824 Sep 25 17:11:40 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:40 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eba69c46-1218-413b-b41a-df97ebd0dc49 tempest-VolumesExtendTest-1243595684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0" returned: 0 in 0.420s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eba69c46-1218-413b-b41a-df97ebd0dc49 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:40 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0 Sep 25 17:11:40 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:41 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eba69c46-1218-413b-b41a-df97ebd0dc49 tempest-VolumesExtendTest-1243595684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0" returned: 0 in 0.315s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:41 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eba69c46-1218-413b-b41a-df97ebd0dc49 tempest-VolumesExtendTest-1243595684 None] Lock "cinder-quobyte-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0" released by "delete_volume" :: held 0.786s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:41 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-eba69c46-1218-413b-b41a-df97ebd0dc49 tempest-VolumesExtendTest-1243595684 None] Created reservations ['4e77319e-92cb-443d-b91e-81ee1e9178ca', '8fbb1651-36a1-42a2-805b-d04f5c4f4424', '8bd0de8a-955a-461d-8349-52e3059e107a', '183aac6d-4849-4d8d-b41e-1b72e8f9b643'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:11:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eba69c46-1218-413b-b41a-df97ebd0dc49 tempest-VolumesExtendTest-1243595684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eba69c46-1218-413b-b41a-df97ebd0dc49 tempest-VolumesExtendTest-1243595684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-eba69c46-1218-413b-b41a-df97ebd0dc49 tempest-VolumesExtendTest-1243595684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-eba69c46-1218-413b-b41a-df97ebd0dc49 tempest-VolumesExtendTest-1243595684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eba69c46-1218-413b-b41a-df97ebd0dc49 tempest-VolumesExtendTest-1243595684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eba69c46-1218-413b-b41a-df97ebd0dc49 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:41 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:11:41 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:41 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2a54981f-6847-4525-9b4b-75678e9fca9c 1073741824" returned: 0 in 0.569s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2a54981f-6847-4525-9b4b-75678e9fca9c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:41 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2a54981f-6847-4525-9b4b-75678e9fca9c Sep 25 17:11:41 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:41 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eba69c46-1218-413b-b41a-df97ebd0dc49 tempest-VolumesExtendTest-1243595684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.365s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:41 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-eba69c46-1218-413b-b41a-df97ebd0dc49 tempest-VolumesExtendTest-1243595684 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:11:41 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-eba69c46-1218-413b-b41a-df97ebd0dc49 tempest-VolumesExtendTest-1243595684 None] Deleted volume successfully. Sep 25 17:11:41 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eba69c46-1218-413b-b41a-df97ebd0dc49 tempest-VolumesExtendTest-1243595684 None] Lock "cinder-49caf7f6-61f4-433d-a96e-f2a2d7ba39c0-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:41 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2a54981f-6847-4525-9b4b-75678e9fca9c" returned: 0 in 0.490s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:11:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3cdce1c-67e4-4cd4-96b3-43321fdaea50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a54981f-6847-4525-9b4b-75678e9fca9c', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f620cb-e72f-4dfd-a67c-a9a728d4ddd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:41 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Volume volume-2a54981f-6847-4525-9b4b-75678e9fca9c (2a54981f-6847-4525-9b4b-75678e9fca9c): created successfully Sep 25 17:11:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f620cb-e72f-4dfd-a67c-a9a728d4ddd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Flow 'volume_create_manager' (b4b32303-2199-4d02-8164-95730b32acbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:41 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-8c191170-7a59-4836-be69-5153d1b9d6da tempest-VolumesNegativeTest-789302837 None] Created volume successfully. Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Flow 'volume_create_manager' (5401c77c-5ce5-411c-aea5-2b7ce293aaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d948ca-98eb-4b46-9275-9712eeba4886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d948ca-98eb-4b46-9275-9712eeba4886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-454577155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b54b60-8c30-4416-a721-20e0702bae9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a8ad6d4913749f6b63266744fb6f5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:42Z,use_quota=True,user_id='83d7ab2ec51f46439dc7b1447360fc00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503b6151-4e29-4ec3-beb2-7e71dd42bded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503b6151-4e29-4ec3-beb2-7e71dd42bded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc97d741-5996-4bb7-a4e9-f32ddd250318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc97d741-5996-4bb7-a4e9-f32ddd250318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44b54b60-8c30-4416-a721-20e0702bae9c', 'volume_name': 'volume-44b54b60-8c30-4416-a721-20e0702bae9c', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e69500db-53f8-4c91-ba9c-a4315076a612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e69500db-53f8-4c91-ba9c-a4315076a612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef8d995-4732-4a4b-bdee-2a216e9810cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:42 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Volume 44b54b60-8c30-4416-a721-20e0702bae9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44b54b60-8c30-4416-a721-20e0702bae9c', 'volume_size': 1} Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-454577155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b54b60-8c30-4416-a721-20e0702bae9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a8ad6d4913749f6b63266744fb6f5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:42Z,use_quota=True,user_id='83d7ab2ec51f46439dc7b1447360fc00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Creating volume 44b54b60-8c30-4416-a721-20e0702bae9c {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:11:42 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:42 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c 1073741824 Sep 25 17:11:42 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:42 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c 1073741824" returned: 0 in 0.569s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:42 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c Sep 25 17:11:42 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:43 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c" returned: 0 in 0.323s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:11:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:43 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef8d995-4732-4a4b-bdee-2a216e9810cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44b54b60-8c30-4416-a721-20e0702bae9c', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:43 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (098aaf4b-149e-4264-8d35-095b71fd3f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:43 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Volume volume-44b54b60-8c30-4416-a721-20e0702bae9c (44b54b60-8c30-4416-a721-20e0702bae9c): created successfully Sep 25 17:11:43 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (098aaf4b-149e-4264-8d35-095b71fd3f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:43 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Flow 'volume_create_manager' (5401c77c-5ce5-411c-aea5-2b7ce293aaf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:43 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-a9f813b3-a0a9-4c41-a696-fab67739c9ec tempest-VolumesExtendTest-1243595684 None] Created volume successfully. Sep 25 17:11:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e3b71667-e491-45b2-87bb-b26711c01618 tempest-VolumesExtendTest-1243595684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e3b71667-e491-45b2-87bb-b26711c01618 tempest-VolumesExtendTest-1243595684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-e3b71667-e491-45b2-87bb-b26711c01618 tempest-VolumesExtendTest-1243595684 None] Creating offline snapshot 7903f240-f459-4aad-97db-5194afc262b3 of volume 44b54b60-8c30-4416-a721-20e0702bae9c {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:11:44 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44be288-a1c3-4e2d-9dfb-b8b8f99f55a4]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e3b71667-e491-45b2-87bb-b26711c01618 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:44 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c Sep 25 17:11:44 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-75c5bcaa-92ce-4fca-ac4d-b460559e9a60 tempest-AttachVolumeShelveTestJSON-2117417879 None] Acquiring lock "cinder-1bbbd509-0338-4e2d-9c74-0c4268535c90-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-75c5bcaa-92ce-4fca-ac4d-b460559e9a60 tempest-AttachVolumeShelveTestJSON-2117417879 None] Lock "cinder-1bbbd509-0338-4e2d-9c74-0c4268535c90-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-75c5bcaa-92ce-4fca-ac4d-b460559e9a60 tempest-AttachVolumeShelveTestJSON-2117417879 None] Acquiring lock "cinder-quobyte-1bbbd509-0338-4e2d-9c74-0c4268535c90" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-75c5bcaa-92ce-4fca-ac4d-b460559e9a60 tempest-AttachVolumeShelveTestJSON-2117417879 None] Lock "cinder-quobyte-1bbbd509-0338-4e2d-9c74-0c4268535c90" acquired by "delete_volume" :: waited 0.033s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:45 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e3b71667-e491-45b2-87bb-b26711c01618 tempest-VolumesExtendTest-1243595684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c" returned: 0 in 0.656s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e3b71667-e491-45b2-87bb-b26711c01618 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.7903f240-f459-4aad-97db-5194afc262b3 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:45 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce23cc81-6ca9-42a8-964b-35fe0a7c4976]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-75c5bcaa-92ce-4fca-ac4d-b460559e9a60 tempest-AttachVolumeShelveTestJSON-2117417879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1bbbd509-0338-4e2d-9c74-0c4268535c90 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:45 devstack sudo[96171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.7903f240-f459-4aad-97db-5194afc262b3 1G Sep 25 17:11:45 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:45 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-5ac90269-a9f1-4ccc-b97b-d9f67e0936aa req-37ac9d3e-4f7d-4886-9d16-590eaf89cc1c tempest-AttachVolumeTestJSON-1624605778 None] Terminate volume connection completed successfully. Sep 25 17:11:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-5ac90269-a9f1-4ccc-b97b-d9f67e0936aa req-37ac9d3e-4f7d-4886-9d16-590eaf89cc1c tempest-AttachVolumeTestJSON-1624605778 None] Deleting attachment 86980518-8367-435f-a316-c876f3065e5c. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:11:45 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1bbbd509-0338-4e2d-9c74-0c4268535c90 Sep 25 17:11:45 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:46 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-75c5bcaa-92ce-4fca-ac4d-b460559e9a60 tempest-AttachVolumeShelveTestJSON-2117417879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1bbbd509-0338-4e2d-9c74-0c4268535c90" returned: 0 in 0.652s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-75c5bcaa-92ce-4fca-ac4d-b460559e9a60 tempest-AttachVolumeShelveTestJSON-2117417879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1bbbd509-0338-4e2d-9c74-0c4268535c90 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:46 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1bbbd509-0338-4e2d-9c74-0c4268535c90 Sep 25 17:11:46 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:46 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e3b71667-e491-45b2-87bb-b26711c01618 tempest-VolumesExtendTest-1243595684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.7903f240-f459-4aad-97db-5194afc262b3 1G" returned: 0 in 0.787s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e3b71667-e491-45b2-87bb-b26711c01618 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44b54b60-8c30-4416-a721-20e0702bae9c -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.7903f240-f459-4aad-97db-5194afc262b3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:46 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44b54b60-8c30-4416-a721-20e0702bae9c -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.7903f240-f459-4aad-97db-5194afc262b3 Sep 25 17:11:46 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:46 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-75c5bcaa-92ce-4fca-ac4d-b460559e9a60 tempest-AttachVolumeShelveTestJSON-2117417879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1bbbd509-0338-4e2d-9c74-0c4268535c90" returned: 0 in 0.523s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:46 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-75c5bcaa-92ce-4fca-ac4d-b460559e9a60 tempest-AttachVolumeShelveTestJSON-2117417879 None] Lock "cinder-quobyte-1bbbd509-0338-4e2d-9c74-0c4268535c90" released by "delete_volume" :: held 1.260s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:46 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e3b71667-e491-45b2-87bb-b26711c01618 tempest-VolumesExtendTest-1243595684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44b54b60-8c30-4416-a721-20e0702bae9c -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.7903f240-f459-4aad-97db-5194afc262b3" returned: 0 in 0.475s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:46 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-e3b71667-e491-45b2-87bb-b26711c01618 tempest-VolumesExtendTest-1243595684 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.7903f240-f459-4aad-97db-5194afc262b3 is being set with open permissions: ugo+rw Sep 25 17:11:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e3b71667-e491-45b2-87bb-b26711c01618 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.7903f240-f459-4aad-97db-5194afc262b3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:46 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.7903f240-f459-4aad-97db-5194afc262b3 Sep 25 17:11:46 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:46 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-75c5bcaa-92ce-4fca-ac4d-b460559e9a60 tempest-AttachVolumeShelveTestJSON-2117417879 None] Created reservations ['195c6a87-04bd-4bbe-a820-9577e3c37fa1', 'f958e5ad-5297-48ed-b1d4-1c91c52a1ecf', 'a6a64a23-37ae-4068-8260-25745b27dedd', '94070e0c-5f37-4ba0-8255-495348c63eea'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:11:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-75c5bcaa-92ce-4fca-ac4d-b460559e9a60 tempest-AttachVolumeShelveTestJSON-2117417879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-75c5bcaa-92ce-4fca-ac4d-b460559e9a60 tempest-AttachVolumeShelveTestJSON-2117417879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:46 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-75c5bcaa-92ce-4fca-ac4d-b460559e9a60 tempest-AttachVolumeShelveTestJSON-2117417879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:46 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-75c5bcaa-92ce-4fca-ac4d-b460559e9a60 tempest-AttachVolumeShelveTestJSON-2117417879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-75c5bcaa-92ce-4fca-ac4d-b460559e9a60 tempest-AttachVolumeShelveTestJSON-2117417879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-75c5bcaa-92ce-4fca-ac4d-b460559e9a60 tempest-AttachVolumeShelveTestJSON-2117417879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:46 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:11:46 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:46 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e3b71667-e491-45b2-87bb-b26711c01618 tempest-VolumesExtendTest-1243595684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.7903f240-f459-4aad-97db-5194afc262b3" returned: 0 in 0.293s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e3b71667-e491-45b2-87bb-b26711c01618 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:47 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.info Sep 25 17:11:47 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:47 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-75c5bcaa-92ce-4fca-ac4d-b460559e9a60 tempest-AttachVolumeShelveTestJSON-2117417879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.280s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:47 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-75c5bcaa-92ce-4fca-ac4d-b460559e9a60 tempest-AttachVolumeShelveTestJSON-2117417879 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:11:47 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-75c5bcaa-92ce-4fca-ac4d-b460559e9a60 tempest-AttachVolumeShelveTestJSON-2117417879 None] Deleted volume successfully. Sep 25 17:11:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-75c5bcaa-92ce-4fca-ac4d-b460559e9a60 tempest-AttachVolumeShelveTestJSON-2117417879 None] Lock "cinder-1bbbd509-0338-4e2d-9c74-0c4268535c90-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:47 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e3b71667-e491-45b2-87bb-b26711c01618 tempest-VolumesExtendTest-1243595684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.info" returned: 0 in 0.326s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:47 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-e3b71667-e491-45b2-87bb-b26711c01618 tempest-VolumesExtendTest-1243595684 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.info is being set with open permissions: ugo+rw Sep 25 17:11:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e3b71667-e491-45b2-87bb-b26711c01618 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:47 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.info Sep 25 17:11:47 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:47 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e3b71667-e491-45b2-87bb-b26711c01618 tempest-VolumesExtendTest-1243595684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.info" returned: 0 in 0.297s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e3b71667-e491-45b2-87bb-b26711c01618 tempest-VolumesExtendTest-1243595684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.993s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:47 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-e3b71667-e491-45b2-87bb-b26711c01618 tempest-VolumesExtendTest-1243595684 None] Create snapshot completed successfully Sep 25 17:11:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0cb045df-b8f8-477d-95a8-0d144101e68e tempest-VolumesExtendTest-1243595684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0cb045df-b8f8-477d-95a8-0d144101e68e tempest-VolumesExtendTest-1243595684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:47 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[157ded56-3103-4357-8463-c47398f8a6d7]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0cb045df-b8f8-477d-95a8-0d144101e68e tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:48 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c Sep 25 17:11:48 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:48 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0cb045df-b8f8-477d-95a8-0d144101e68e tempest-VolumesExtendTest-1243595684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c" returned: 0 in 0.457s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0cb045df-b8f8-477d-95a8-0d144101e68e tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.7903f240-f459-4aad-97db-5194afc262b3 2G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0cb045df-b8f8-477d-95a8-0d144101e68e tempest-VolumesExtendTest-1243595684 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.7903f240-f459-4aad-97db-5194afc262b3 2G" returned: 0 in 0.173s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0cb045df-b8f8-477d-95a8-0d144101e68e tempest-VolumesExtendTest-1243595684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.705s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:48 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-0cb045df-b8f8-477d-95a8-0d144101e68e tempest-VolumesExtendTest-1243595684 None] Extend volume completed successfully. Sep 25 17:11:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0f589fd3-1578-4be5-936a-7c03a5d1baaa tempest-VolumesExtendTest-1243595684 None] Acquiring lock "cinder-7903f240-f459-4aad-97db-5194afc262b3-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0f589fd3-1578-4be5-936a-7c03a5d1baaa tempest-VolumesExtendTest-1243595684 None] Lock "cinder-7903f240-f459-4aad-97db-5194afc262b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0f589fd3-1578-4be5-936a-7c03a5d1baaa tempest-VolumesExtendTest-1243595684 None] Acquiring lock "cinder-quobyte-44b54b60-8c30-4416-a721-20e0702bae9c" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0f589fd3-1578-4be5-936a-7c03a5d1baaa tempest-VolumesExtendTest-1243595684 None] Lock "cinder-quobyte-44b54b60-8c30-4416-a721-20e0702bae9c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0f589fd3-1578-4be5-936a-7c03a5d1baaa tempest-VolumesExtendTest-1243595684 None] Acquiring lock "cinder-quobyte-7903f240-f459-4aad-97db-5194afc262b3" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0f589fd3-1578-4be5-936a-7c03a5d1baaa tempest-VolumesExtendTest-1243595684 None] Lock "cinder-quobyte-7903f240-f459-4aad-97db-5194afc262b3" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-0f589fd3-1578-4be5-936a-7c03a5d1baaa tempest-VolumesExtendTest-1243595684 None] Deleting offline snapshot 7903f240-f459-4aad-97db-5194afc262b3 of volume 44b54b60-8c30-4416-a721-20e0702bae9c {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:11:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-0f589fd3-1578-4be5-936a-7c03a5d1baaa tempest-VolumesExtendTest-1243595684 None] snapshot_file for this snap is: volume-44b54b60-8c30-4416-a721-20e0702bae9c.7903f240-f459-4aad-97db-5194afc262b3 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:11:49 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3e4916-767b-4820-a71e-7757405cab24]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0f589fd3-1578-4be5-936a-7c03a5d1baaa tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.7903f240-f459-4aad-97db-5194afc262b3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:49 devstack sudo[96245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.7903f240-f459-4aad-97db-5194afc262b3 Sep 25 17:11:49 devstack sudo[96245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:50 devstack sudo[96245]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0f589fd3-1578-4be5-936a-7c03a5d1baaa tempest-VolumesExtendTest-1243595684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.7903f240-f459-4aad-97db-5194afc262b3" returned: 0 in 0.752s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-0f589fd3-1578-4be5-936a-7c03a5d1baaa tempest-VolumesExtendTest-1243595684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44b54b60-8c30-4416-a721-20e0702bae9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:11:50 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[674fb22d-b9c9-41f9-be60-243fa43dd11e]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0f589fd3-1578-4be5-936a-7c03a5d1baaa tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:50 devstack sudo[96285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c Sep 25 17:11:50 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:50 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0f589fd3-1578-4be5-936a-7c03a5d1baaa tempest-VolumesExtendTest-1243595684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c" returned: 0 in 0.588s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0f589fd3-1578-4be5-936a-7c03a5d1baaa tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.7903f240-f459-4aad-97db-5194afc262b3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:50 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.7903f240-f459-4aad-97db-5194afc262b3 Sep 25 17:11:50 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:51 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0f589fd3-1578-4be5-936a-7c03a5d1baaa tempest-VolumesExtendTest-1243595684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.7903f240-f459-4aad-97db-5194afc262b3" returned: 0 in 0.540s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0f589fd3-1578-4be5-936a-7c03a5d1baaa tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.7903f240-f459-4aad-97db-5194afc262b3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:51 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.7903f240-f459-4aad-97db-5194afc262b3 Sep 25 17:11:51 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:51 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0f589fd3-1578-4be5-936a-7c03a5d1baaa tempest-VolumesExtendTest-1243595684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c.7903f240-f459-4aad-97db-5194afc262b3" returned: 0 in 0.433s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0f589fd3-1578-4be5-936a-7c03a5d1baaa tempest-VolumesExtendTest-1243595684 None] Lock "cinder-quobyte-7903f240-f459-4aad-97db-5194afc262b3" released by "_delete_snapshot" :: held 2.554s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0f589fd3-1578-4be5-936a-7c03a5d1baaa tempest-VolumesExtendTest-1243595684 None] Lock "cinder-quobyte-44b54b60-8c30-4416-a721-20e0702bae9c" released by "delete_snapshot" :: held 2.609s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:52 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-0f589fd3-1578-4be5-936a-7c03a5d1baaa tempest-VolumesExtendTest-1243595684 None] Created reservations ['d57715f2-acfd-44fd-af16-fcf67c58a2d8', '53f8a458-89b4-4ff3-a1e3-aaba7a5626a6', 'a6419cfe-886f-4e01-a29e-7fcf8cb2b90b', 'cb5577da-91e2-44fb-989a-7d4cc3f5cb8b'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:11:52 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-0f589fd3-1578-4be5-936a-7c03a5d1baaa tempest-VolumesExtendTest-1243595684 None] Delete snapshot completed successfully. Sep 25 17:11:52 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0f589fd3-1578-4be5-936a-7c03a5d1baaa tempest-VolumesExtendTest-1243595684 None] Lock "cinder-7903f240-f459-4aad-97db-5194afc262b3-delete_snapshot" released by "delete_snapshot" :: held 2.937s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:52 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6978c7fc-fa6d-4ff4-ac77-547e94ae3155 tempest-VolumesExtendTest-1243595684 None] Acquiring lock "cinder-44b54b60-8c30-4416-a721-20e0702bae9c-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:52 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6978c7fc-fa6d-4ff4-ac77-547e94ae3155 tempest-VolumesExtendTest-1243595684 None] Lock "cinder-44b54b60-8c30-4416-a721-20e0702bae9c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:52 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6978c7fc-fa6d-4ff4-ac77-547e94ae3155 tempest-VolumesExtendTest-1243595684 None] Acquiring lock "cinder-quobyte-44b54b60-8c30-4416-a721-20e0702bae9c" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:52 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6978c7fc-fa6d-4ff4-ac77-547e94ae3155 tempest-VolumesExtendTest-1243595684 None] Lock "cinder-quobyte-44b54b60-8c30-4416-a721-20e0702bae9c" acquired by "delete_volume" :: waited 0.033s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:52 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19f20bd-1506-4561-be25-6f7e6eecf032]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6978c7fc-fa6d-4ff4-ac77-547e94ae3155 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:53 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c Sep 25 17:11:53 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:11:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:53 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:11:53 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:54 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6978c7fc-fa6d-4ff4-ac77-547e94ae3155 tempest-VolumesExtendTest-1243595684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c" returned: 0 in 1.245s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6978c7fc-fa6d-4ff4-ac77-547e94ae3155 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:54 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c Sep 25 17:11:54 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:54 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.753s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:54 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:11:54 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:11:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 28 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:11:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:11:54 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6978c7fc-fa6d-4ff4-ac77-547e94ae3155 tempest-VolumesExtendTest-1243595684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-44b54b60-8c30-4416-a721-20e0702bae9c" returned: 0 in 0.659s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6978c7fc-fa6d-4ff4-ac77-547e94ae3155 tempest-VolumesExtendTest-1243595684 None] Lock "cinder-quobyte-44b54b60-8c30-4416-a721-20e0702bae9c" released by "delete_volume" :: held 2.071s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:55 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-6978c7fc-fa6d-4ff4-ac77-547e94ae3155 tempest-VolumesExtendTest-1243595684 None] Created reservations ['755037ba-e44a-4b0a-b91a-8d3d7d689b6d', 'cf3aac88-3000-440a-b0e2-ee02138bbb8c', 'e75293b4-a1df-402e-8555-cf127f37c15c', 'df350f0d-a314-4a6f-8e97-1ab4f99ec17a'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:11:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6978c7fc-fa6d-4ff4-ac77-547e94ae3155 tempest-VolumesExtendTest-1243595684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6978c7fc-fa6d-4ff4-ac77-547e94ae3155 tempest-VolumesExtendTest-1243595684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6978c7fc-fa6d-4ff4-ac77-547e94ae3155 tempest-VolumesExtendTest-1243595684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6978c7fc-fa6d-4ff4-ac77-547e94ae3155 tempest-VolumesExtendTest-1243595684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6978c7fc-fa6d-4ff4-ac77-547e94ae3155 tempest-VolumesExtendTest-1243595684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6978c7fc-fa6d-4ff4-ac77-547e94ae3155 tempest-VolumesExtendTest-1243595684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:55 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:11:55 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:55 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6978c7fc-fa6d-4ff4-ac77-547e94ae3155 tempest-VolumesExtendTest-1243595684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.432s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:55 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-6978c7fc-fa6d-4ff4-ac77-547e94ae3155 tempest-VolumesExtendTest-1243595684 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:11:55 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-6978c7fc-fa6d-4ff4-ac77-547e94ae3155 tempest-VolumesExtendTest-1243595684 None] Deleted volume successfully. Sep 25 17:11:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6978c7fc-fa6d-4ff4-ac77-547e94ae3155 tempest-VolumesExtendTest-1243595684 None] Lock "cinder-44b54b60-8c30-4416-a721-20e0702bae9c-delete_volume" released by "delete_volume" :: held 3.145s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:03 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:12:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Flow 'volume_create_manager' (8bab0c65-cfe8-4bc3-b1f0-9fdf3f66d947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (984523df-b187-4f61-be35-21c3ce53bb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (984523df-b187-4f61-be35-21c3ce53bb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-491064404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9f32dcb-26e0-40f2-8526-8b810462bdd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a9641ef9244f76b40b2427e8ed9012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:04Z,use_quota=True,user_id='c2691f0e23f24bfb862fb21198c075be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ae2b42-85fc-4e23-af09-5fbeadcbb582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ae2b42-85fc-4e23-af09-5fbeadcbb582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a408f5a1-6470-4b01-853e-3352a68907ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a408f5a1-6470-4b01-853e-3352a68907ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9f32dcb-26e0-40f2-8526-8b810462bdd0', 'volume_name': 'volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0', 'volume_size': 2}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b060d0b4-930b-4ff4-9223-d34853c9704d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b060d0b4-930b-4ff4-9223-d34853c9704d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748297d7-7c79-4370-a7ba-9a3000c30a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:03 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Volume b9f32dcb-26e0-40f2-8526-8b810462bdd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0', 'volume_size': 2} Sep 25 17:12:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-491064404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9f32dcb-26e0-40f2-8526-8b810462bdd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a9641ef9244f76b40b2427e8ed9012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:04Z,use_quota=True,user_id='c2691f0e23f24bfb862fb21198c075be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:12:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Creating volume b9f32dcb-26e0-40f2-8526-8b810462bdd0 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:12:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:12:03 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:12:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0 2147483648 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:03 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0 2147483648 Sep 25 17:12:03 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:04 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0 2147483648" returned: 0 in 0.774s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:04 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0 Sep 25 17:12:04 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:05 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0" returned: 0 in 0.449s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:12:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748297d7-7c79-4370-a7ba-9a3000c30a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0', 'volume_size': 2}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a686717-d3de-49ee-8d37-844daf8c3047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:05 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Volume volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0 (b9f32dcb-26e0-40f2-8526-8b810462bdd0): created successfully Sep 25 17:12:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a686717-d3de-49ee-8d37-844daf8c3047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Flow 'volume_create_manager' (8bab0c65-cfe8-4bc3-b1f0-9fdf3f66d947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:05 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-c0ac480c-f5f4-45b1-824d-c3e91d09cd25 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Created volume successfully. Sep 25 17:12:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7ac3d272-9f72-457d-972a-b99bb1444d47 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7ac3d272-9f72-457d-972a-b99bb1444d47 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-7ac3d272-9f72-457d-972a-b99bb1444d47 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Creating offline snapshot 908bf8e9-3e1a-4f36-a471-ae0e17f9f654 of volume b9f32dcb-26e0-40f2-8526-8b810462bdd0 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:12:06 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[056af65c-e7c6-4d8c-b05c-ddc4c90cb248]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7ac3d272-9f72-457d-972a-b99bb1444d47 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:06 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0 Sep 25 17:12:06 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:06 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7ac3d272-9f72-457d-972a-b99bb1444d47 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0" returned: 0 in 0.592s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7ac3d272-9f72-457d-972a-b99bb1444d47 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.908bf8e9-3e1a-4f36-a471-ae0e17f9f654 2G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:06 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.908bf8e9-3e1a-4f36-a471-ae0e17f9f654 2G Sep 25 17:12:06 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:07 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7ac3d272-9f72-457d-972a-b99bb1444d47 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.908bf8e9-3e1a-4f36-a471-ae0e17f9f654 2G" returned: 0 in 0.749s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7ac3d272-9f72-457d-972a-b99bb1444d47 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.908bf8e9-3e1a-4f36-a471-ae0e17f9f654 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:07 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.908bf8e9-3e1a-4f36-a471-ae0e17f9f654 Sep 25 17:12:07 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:07 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7ac3d272-9f72-457d-972a-b99bb1444d47 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.908bf8e9-3e1a-4f36-a471-ae0e17f9f654" returned: 0 in 0.525s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:07 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-7ac3d272-9f72-457d-972a-b99bb1444d47 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.908bf8e9-3e1a-4f36-a471-ae0e17f9f654 is being set with open permissions: ugo+rw Sep 25 17:12:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7ac3d272-9f72-457d-972a-b99bb1444d47 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.908bf8e9-3e1a-4f36-a471-ae0e17f9f654 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:07 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.908bf8e9-3e1a-4f36-a471-ae0e17f9f654 Sep 25 17:12:07 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:08 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7ac3d272-9f72-457d-972a-b99bb1444d47 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.908bf8e9-3e1a-4f36-a471-ae0e17f9f654" returned: 0 in 0.477s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7ac3d272-9f72-457d-972a-b99bb1444d47 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:08 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.info Sep 25 17:12:08 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:08 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7ac3d272-9f72-457d-972a-b99bb1444d47 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.info" returned: 0 in 0.336s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:08 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-7ac3d272-9f72-457d-972a-b99bb1444d47 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.info is being set with open permissions: ugo+rw Sep 25 17:12:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7ac3d272-9f72-457d-972a-b99bb1444d47 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:08 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.info Sep 25 17:12:08 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:09 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7ac3d272-9f72-457d-972a-b99bb1444d47 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.info" returned: 0 in 0.315s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7ac3d272-9f72-457d-972a-b99bb1444d47 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.164s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:09 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-7ac3d272-9f72-457d-972a-b99bb1444d47 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Create snapshot completed successfully Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d61a2d3c-e395-4ca7-b168-1c8692c71a19 tempest-VolumesNegativeTest-789302837 None] Acquiring lock "cinder-2a54981f-6847-4525-9b4b-75678e9fca9c-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d61a2d3c-e395-4ca7-b168-1c8692c71a19 tempest-VolumesNegativeTest-789302837 None] Lock "cinder-2a54981f-6847-4525-9b4b-75678e9fca9c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d61a2d3c-e395-4ca7-b168-1c8692c71a19 tempest-VolumesNegativeTest-789302837 None] Acquiring lock "cinder-quobyte-2a54981f-6847-4525-9b4b-75678e9fca9c" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d61a2d3c-e395-4ca7-b168-1c8692c71a19 tempest-VolumesNegativeTest-789302837 None] Lock "cinder-quobyte-2a54981f-6847-4525-9b4b-75678e9fca9c" acquired by "delete_volume" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[2553a133-b47d-4117-8c34-b5adbd6f3267]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d61a2d3c-e395-4ca7-b168-1c8692c71a19 tempest-VolumesNegativeTest-789302837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2a54981f-6847-4525-9b4b-75678e9fca9c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:10 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2a54981f-6847-4525-9b4b-75678e9fca9c Sep 25 17:12:10 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-134b6f9a-703f-4eae-8aa4-05ba60df68e4 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Acquiring lock "cinder-908bf8e9-3e1a-4f36-a471-ae0e17f9f654-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-134b6f9a-703f-4eae-8aa4-05ba60df68e4 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Lock "cinder-908bf8e9-3e1a-4f36-a471-ae0e17f9f654-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-134b6f9a-703f-4eae-8aa4-05ba60df68e4 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Acquiring lock "cinder-quobyte-b9f32dcb-26e0-40f2-8526-8b810462bdd0" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-134b6f9a-703f-4eae-8aa4-05ba60df68e4 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Lock "cinder-quobyte-b9f32dcb-26e0-40f2-8526-8b810462bdd0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-134b6f9a-703f-4eae-8aa4-05ba60df68e4 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Acquiring lock "cinder-quobyte-908bf8e9-3e1a-4f36-a471-ae0e17f9f654" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-134b6f9a-703f-4eae-8aa4-05ba60df68e4 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Lock "cinder-quobyte-908bf8e9-3e1a-4f36-a471-ae0e17f9f654" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-134b6f9a-703f-4eae-8aa4-05ba60df68e4 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Deleting offline snapshot 908bf8e9-3e1a-4f36-a471-ae0e17f9f654 of volume b9f32dcb-26e0-40f2-8526-8b810462bdd0 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-134b6f9a-703f-4eae-8aa4-05ba60df68e4 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] snapshot_file for this snap is: volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.908bf8e9-3e1a-4f36-a471-ae0e17f9f654 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ef8615-78dc-4e45-8be4-d3d825d817b9]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-134b6f9a-703f-4eae-8aa4-05ba60df68e4 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.908bf8e9-3e1a-4f36-a471-ae0e17f9f654 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:10 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.908bf8e9-3e1a-4f36-a471-ae0e17f9f654 Sep 25 17:12:10 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:10 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d61a2d3c-e395-4ca7-b168-1c8692c71a19 tempest-VolumesNegativeTest-789302837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2a54981f-6847-4525-9b4b-75678e9fca9c" returned: 0 in 0.414s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d61a2d3c-e395-4ca7-b168-1c8692c71a19 tempest-VolumesNegativeTest-789302837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2a54981f-6847-4525-9b4b-75678e9fca9c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:10 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2a54981f-6847-4525-9b4b-75678e9fca9c Sep 25 17:12:10 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:10 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d61a2d3c-e395-4ca7-b168-1c8692c71a19 tempest-VolumesNegativeTest-789302837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2a54981f-6847-4525-9b4b-75678e9fca9c" returned: 0 in 0.283s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:10 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-134b6f9a-703f-4eae-8aa4-05ba60df68e4 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.908bf8e9-3e1a-4f36-a471-ae0e17f9f654" returned: 0 in 0.434s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-134b6f9a-703f-4eae-8aa4-05ba60df68e4 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d61a2d3c-e395-4ca7-b168-1c8692c71a19 tempest-VolumesNegativeTest-789302837 None] Lock "cinder-quobyte-2a54981f-6847-4525-9b4b-75678e9fca9c" released by "delete_volume" :: held 0.775s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5de7c4a-6372-4a06-bfaf-b62d476f9e46]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-134b6f9a-703f-4eae-8aa4-05ba60df68e4 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:11 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-d61a2d3c-e395-4ca7-b168-1c8692c71a19 tempest-VolumesNegativeTest-789302837 None] Created reservations ['7585c6f1-781f-4348-96ed-f1f8ba387a22', 'd9c51036-4f2e-41f0-bf1f-714e6920a920', '5bba5f1f-f0b7-4824-ba93-467310bcabdb', 'f09ad158-57d6-47c4-a1aa-ec89ba0b389c'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:11 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0 Sep 25 17:12:11 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d61a2d3c-e395-4ca7-b168-1c8692c71a19 tempest-VolumesNegativeTest-789302837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d61a2d3c-e395-4ca7-b168-1c8692c71a19 tempest-VolumesNegativeTest-789302837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d61a2d3c-e395-4ca7-b168-1c8692c71a19 tempest-VolumesNegativeTest-789302837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d61a2d3c-e395-4ca7-b168-1c8692c71a19 tempest-VolumesNegativeTest-789302837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d61a2d3c-e395-4ca7-b168-1c8692c71a19 tempest-VolumesNegativeTest-789302837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d61a2d3c-e395-4ca7-b168-1c8692c71a19 tempest-VolumesNegativeTest-789302837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:11 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-c4b92b9a-2106-4fdd-8fac-715769f8bf17 tempest-GroupsTest-300763126 None] Group tempest-Group1-870924322: creating Sep 25 17:12:11 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:12:11 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:11 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-c4b92b9a-2106-4fdd-8fac-715769f8bf17 tempest-GroupsTest-300763126 None] Group tempest-Group1-870924322: created successfully Sep 25 17:12:11 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-c4b92b9a-2106-4fdd-8fac-715769f8bf17 tempest-GroupsTest-300763126 None] Create group completed successfully. Sep 25 17:12:11 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-134b6f9a-703f-4eae-8aa4-05ba60df68e4 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0" returned: 0 in 0.424s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-134b6f9a-703f-4eae-8aa4-05ba60df68e4 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.908bf8e9-3e1a-4f36-a471-ae0e17f9f654 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:11 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d61a2d3c-e395-4ca7-b168-1c8692c71a19 tempest-VolumesNegativeTest-789302837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.271s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:11 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-d61a2d3c-e395-4ca7-b168-1c8692c71a19 tempest-VolumesNegativeTest-789302837 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:12:11 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.908bf8e9-3e1a-4f36-a471-ae0e17f9f654 Sep 25 17:12:11 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:11 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-d61a2d3c-e395-4ca7-b168-1c8692c71a19 tempest-VolumesNegativeTest-789302837 None] Deleted volume successfully. Sep 25 17:12:11 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d61a2d3c-e395-4ca7-b168-1c8692c71a19 tempest-VolumesNegativeTest-789302837 None] Lock "cinder-2a54981f-6847-4525-9b4b-75678e9fca9c-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:11 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-134b6f9a-703f-4eae-8aa4-05ba60df68e4 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.908bf8e9-3e1a-4f36-a471-ae0e17f9f654" returned: 0 in 0.383s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-134b6f9a-703f-4eae-8aa4-05ba60df68e4 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.908bf8e9-3e1a-4f36-a471-ae0e17f9f654 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:11 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.908bf8e9-3e1a-4f36-a471-ae0e17f9f654 Sep 25 17:12:11 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:12 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-134b6f9a-703f-4eae-8aa4-05ba60df68e4 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0.908bf8e9-3e1a-4f36-a471-ae0e17f9f654" returned: 0 in 0.249s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-134b6f9a-703f-4eae-8aa4-05ba60df68e4 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Lock "cinder-quobyte-908bf8e9-3e1a-4f36-a471-ae0e17f9f654" released by "_delete_snapshot" :: held 1.631s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-134b6f9a-703f-4eae-8aa4-05ba60df68e4 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Lock "cinder-quobyte-b9f32dcb-26e0-40f2-8526-8b810462bdd0" released by "delete_snapshot" :: held 1.663s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:12 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-134b6f9a-703f-4eae-8aa4-05ba60df68e4 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Created reservations ['71d0c8ec-5513-472c-b714-a75dbdae15fc', '8030dc21-d6c4-471e-87f0-fbadbc6cea86', '095a3781-cd15-4e14-bf30-a5991b80a8dc', 'ec876f3b-f7ff-43d6-821c-758e08f62d55'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:12 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-134b6f9a-703f-4eae-8aa4-05ba60df68e4 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Delete snapshot completed successfully. Sep 25 17:12:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-134b6f9a-703f-4eae-8aa4-05ba60df68e4 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Lock "cinder-908bf8e9-3e1a-4f36-a471-ae0e17f9f654-delete_snapshot" released by "delete_snapshot" :: held 1.826s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:12 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-1c901f1f-57ec-43b5-baee-fa193891e728 tempest-GroupsTest-300763126 None] Group tempest-Group2-281465909: creating Sep 25 17:12:12 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-1c901f1f-57ec-43b5-baee-fa193891e728 tempest-GroupsTest-300763126 None] Group tempest-Group2-281465909: created successfully Sep 25 17:12:12 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-1c901f1f-57ec-43b5-baee-fa193891e728 tempest-GroupsTest-300763126 None] Create group completed successfully. Sep 25 17:12:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ad81e3b9-053a-455f-8ba3-e39ba8fbc339 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Acquiring lock "cinder-b9f32dcb-26e0-40f2-8526-8b810462bdd0-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ad81e3b9-053a-455f-8ba3-e39ba8fbc339 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Lock "cinder-b9f32dcb-26e0-40f2-8526-8b810462bdd0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ad81e3b9-053a-455f-8ba3-e39ba8fbc339 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Acquiring lock "cinder-quobyte-b9f32dcb-26e0-40f2-8526-8b810462bdd0" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ad81e3b9-053a-455f-8ba3-e39ba8fbc339 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Lock "cinder-quobyte-b9f32dcb-26e0-40f2-8526-8b810462bdd0" acquired by "delete_volume" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:12 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e25ba58-3b81-4db8-8b09-5c80f5b7ccf8]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ad81e3b9-053a-455f-8ba3-e39ba8fbc339 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:12 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0 Sep 25 17:12:12 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:13 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ad81e3b9-053a-455f-8ba3-e39ba8fbc339 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0" returned: 0 in 0.397s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ad81e3b9-053a-455f-8ba3-e39ba8fbc339 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:13 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0 Sep 25 17:12:13 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:13 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ad81e3b9-053a-455f-8ba3-e39ba8fbc339 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9f32dcb-26e0-40f2-8526-8b810462bdd0" returned: 0 in 0.276s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:13 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ad81e3b9-053a-455f-8ba3-e39ba8fbc339 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Lock "cinder-quobyte-b9f32dcb-26e0-40f2-8526-8b810462bdd0" released by "delete_volume" :: held 0.742s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:13 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-ad81e3b9-053a-455f-8ba3-e39ba8fbc339 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Created reservations ['1a50e5e9-ddc0-43e7-b593-fc4f1a27919b', 'da80c752-88a3-4e17-9710-ba2a4011c97f', 'd33a179a-c84e-432c-8f4b-fa71279cda80', '0bbebfe6-8e96-4b46-8799-98c435b644cc'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ad81e3b9-053a-455f-8ba3-e39ba8fbc339 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ad81e3b9-053a-455f-8ba3-e39ba8fbc339 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ad81e3b9-053a-455f-8ba3-e39ba8fbc339 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ad81e3b9-053a-455f-8ba3-e39ba8fbc339 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ad81e3b9-053a-455f-8ba3-e39ba8fbc339 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ad81e3b9-053a-455f-8ba3-e39ba8fbc339 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:13 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:12:13 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:13 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ad81e3b9-053a-455f-8ba3-e39ba8fbc339 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.309s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:13 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-ad81e3b9-053a-455f-8ba3-e39ba8fbc339 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:12:13 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-ad81e3b9-053a-455f-8ba3-e39ba8fbc339 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Deleted volume successfully. Sep 25 17:12:13 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ad81e3b9-053a-455f-8ba3-e39ba8fbc339 tempest-VolumesSnapshotNegativeTestJSON-28040274 None] Lock "cinder-b9f32dcb-26e0-40f2-8526-8b810462bdd0-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Flow 'volume_create_manager' (9cb7ce2f-d848-4811-bc71-d77e50d4cc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b830cdc-bb19-4f79-b76f-8e1cd067ee79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b830cdc-bb19-4f79-b76f-8e1cd067ee79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-153003934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8bd12efa-31f5-4e66-8a5d-698d075b9c16,host='devstack@QuobyteHD#QuobyteHD',id=4d5f51dd-149b-4a07-a284-bcca05bf7cee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d33b4765de4463ab5e563e1ba3cf0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:14Z,use_quota=True,user_id='16a9c397d33c47a1bd721add258165f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c388182a-d43b-47d0-8b43-708752c3eb43),volume_type_id=c388182a-d43b-47d0-8b43-708752c3eb43)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a609346-ad3f-441e-abd5-158fdba9ab84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a609346-ad3f-441e-abd5-158fdba9ab84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea34a2c-04d6-4c5a-8a52-9096cd6a1cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea34a2c-04d6-4c5a-8a52-9096cd6a1cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d5f51dd-149b-4a07-a284-bcca05bf7cee', 'volume_name': 'volume-4d5f51dd-149b-4a07-a284-bcca05bf7cee', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c6f1ea-a6eb-4f8b-a8f6-7367639e73b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c6f1ea-a6eb-4f8b-a8f6-7367639e73b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb497c3a-f9c1-4407-aadb-a7adbc38b413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:14 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Volume 4d5f51dd-149b-4a07-a284-bcca05bf7cee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d5f51dd-149b-4a07-a284-bcca05bf7cee', 'volume_size': 1} Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8bd12efa-31f5-4e66-8a5d-698d075b9c16,created_at=2026-09-25T15:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-153003934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8bd12efa-31f5-4e66-8a5d-698d075b9c16,host='devstack@QuobyteHD#QuobyteHD',id=4d5f51dd-149b-4a07-a284-bcca05bf7cee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d33b4765de4463ab5e563e1ba3cf0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:14Z,use_quota=True,user_id='16a9c397d33c47a1bd721add258165f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c388182a-d43b-47d0-8b43-708752c3eb43),volume_type_id=c388182a-d43b-47d0-8b43-708752c3eb43)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Creating volume 4d5f51dd-149b-4a07-a284-bcca05bf7cee {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:12:14 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4d5f51dd-149b-4a07-a284-bcca05bf7cee 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:14 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4d5f51dd-149b-4a07-a284-bcca05bf7cee 1073741824 Sep 25 17:12:14 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:14 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4d5f51dd-149b-4a07-a284-bcca05bf7cee 1073741824" returned: 0 in 0.537s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4d5f51dd-149b-4a07-a284-bcca05bf7cee {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:14 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4d5f51dd-149b-4a07-a284-bcca05bf7cee Sep 25 17:12:14 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:12:15 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Flow 'volume_create_manager' (d5a5e59b-7608-4485-8ed1-fd0a208b4635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be82e3fa-1f59-4e38-bb00-afb6a90a16f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4d5f51dd-149b-4a07-a284-bcca05bf7cee" returned: 0 in 0.383s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be82e3fa-1f59-4e38-bb00-afb6a90a16f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-760063825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51914cd2-c64e-4bb3-a5de-e0091ca2d171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48a8289655bb4a669d44c4866c177fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:15Z,use_quota=True,user_id='0bc0ca7a1c9d42fabc62735ddd201f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f117ef1d-6817-442a-a962-6404ed293047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f117ef1d-6817-442a-a962-6404ed293047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3db64f-1a92-4913-b88c-24407e17103c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3db64f-1a92-4913-b88c-24407e17103c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51914cd2-c64e-4bb3-a5de-e0091ca2d171', 'volume_name': 'volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032a6a83-046a-4edc-854f-411179ad79a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032a6a83-046a-4edc-854f-411179ad79a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195850a1-d793-4cb5-a126-cd3d61d0bad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:15 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Volume 51914cd2-c64e-4bb3-a5de-e0091ca2d171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171', 'volume_size': 1} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-760063825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51914cd2-c64e-4bb3-a5de-e0091ca2d171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48a8289655bb4a669d44c4866c177fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:15Z,use_quota=True,user_id='0bc0ca7a1c9d42fabc62735ddd201f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Creating volume 51914cd2-c64e-4bb3-a5de-e0091ca2d171 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:12:15 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb497c3a-f9c1-4407-aadb-a7adbc38b413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d5f51dd-149b-4a07-a284-bcca05bf7cee', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75f4789-d4e2-4bcd-be0b-dd9d302c65ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:15 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171 1073741824 Sep 25 17:12:15 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:15 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Volume volume-4d5f51dd-149b-4a07-a284-bcca05bf7cee (4d5f51dd-149b-4a07-a284-bcca05bf7cee): created successfully Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75f4789-d4e2-4bcd-be0b-dd9d302c65ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Flow 'volume_create_manager' (9cb7ce2f-d848-4811-bc71-d77e50d4cc38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:15 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-ff0c8562-29d3-46a7-981b-c75577dc0546 tempest-GroupsTest-300763126 None] Created volume successfully. Sep 25 17:12:15 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171 1073741824" returned: 0 in 0.527s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:15 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171 Sep 25 17:12:15 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:16 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171" returned: 0 in 0.285s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:12:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195850a1-d793-4cb5-a126-cd3d61d0bad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b451fe-842e-4252-93a5-38c590e18e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:16 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Volume volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171 (51914cd2-c64e-4bb3-a5de-e0091ca2d171): created successfully Sep 25 17:12:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b451fe-842e-4252-93a5-38c590e18e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Flow 'volume_create_manager' (d5a5e59b-7608-4485-8ed1-fd0a208b4635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:16 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-ddb56466-7c1d-4c4b-9c30-2ebf30e217a1 tempest-VolumesSnapshotListTestJSON-1308193248 None] Created volume successfully. Sep 25 17:12:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6a4add1e-7082-4aae-9ba1-1b60093a2f65 tempest-GroupsTest-300763126 None] Acquiring lock "cinder-quobyte-4d5f51dd-149b-4a07-a284-bcca05bf7cee" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6a4add1e-7082-4aae-9ba1-1b60093a2f65 tempest-GroupsTest-300763126 None] Lock "cinder-quobyte-4d5f51dd-149b-4a07-a284-bcca05bf7cee" acquired by "delete_volume" :: waited 0.025s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:17 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9bb12b-5cb7-4973-b6bc-b94c984189f9]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6a4add1e-7082-4aae-9ba1-1b60093a2f65 tempest-GroupsTest-300763126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4d5f51dd-149b-4a07-a284-bcca05bf7cee {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:17 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4d5f51dd-149b-4a07-a284-bcca05bf7cee Sep 25 17:12:17 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-318a9b5a-6c0b-4e7c-89bf-7defec113d20 tempest-VolumesSnapshotListTestJSON-1308193248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-318a9b5a-6c0b-4e7c-89bf-7defec113d20 tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-318a9b5a-6c0b-4e7c-89bf-7defec113d20 tempest-VolumesSnapshotListTestJSON-1308193248 None] Creating offline snapshot 9cd01d2d-4127-4faa-9806-75c7feeaa3ff of volume 51914cd2-c64e-4bb3-a5de-e0091ca2d171 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:12:17 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73eeebb-624d-4c33-9e09-ce094dc85da4]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-318a9b5a-6c0b-4e7c-89bf-7defec113d20 tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:17 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171 Sep 25 17:12:17 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:18 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6a4add1e-7082-4aae-9ba1-1b60093a2f65 tempest-GroupsTest-300763126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4d5f51dd-149b-4a07-a284-bcca05bf7cee" returned: 0 in 0.639s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6a4add1e-7082-4aae-9ba1-1b60093a2f65 tempest-GroupsTest-300763126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4d5f51dd-149b-4a07-a284-bcca05bf7cee {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:18 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4d5f51dd-149b-4a07-a284-bcca05bf7cee Sep 25 17:12:18 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:18 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-318a9b5a-6c0b-4e7c-89bf-7defec113d20 tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171" returned: 0 in 0.566s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-318a9b5a-6c0b-4e7c-89bf-7defec113d20 tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:18 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff 1G Sep 25 17:12:18 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:18 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6a4add1e-7082-4aae-9ba1-1b60093a2f65 tempest-GroupsTest-300763126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4d5f51dd-149b-4a07-a284-bcca05bf7cee" returned: 0 in 0.354s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:18 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6a4add1e-7082-4aae-9ba1-1b60093a2f65 tempest-GroupsTest-300763126 None] Lock "cinder-quobyte-4d5f51dd-149b-4a07-a284-bcca05bf7cee" released by "delete_volume" :: held 1.078s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:18 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-6a4add1e-7082-4aae-9ba1-1b60093a2f65 tempest-GroupsTest-300763126 None] Created reservations ['c8822fb0-cf39-4ad0-8acf-17933fe531cd'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:18 devstack cinder-volume[87211]: WARNING cinder.quota [None req-6a4add1e-7082-4aae-9ba1-1b60093a2f65 tempest-GroupsTest-300763126 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1915224064 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1915224064, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:12:18 devstack cinder-volume[87211]: WARNING cinder.quota [None req-6a4add1e-7082-4aae-9ba1-1b60093a2f65 tempest-GroupsTest-300763126 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1915224064 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1915224064, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:12:18 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-6a4add1e-7082-4aae-9ba1-1b60093a2f65 tempest-GroupsTest-300763126 None] Created reservations ['fc5934e3-f3e8-4bd3-bff4-e265ba5bd1a4', '87ae2427-58b3-4d4e-ac58-9b017cec76ca', 'bcec755b-dcc3-4470-9abc-e74ede32e4ab', '14321545-3a91-4181-976e-2ee121376a61'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6a4add1e-7082-4aae-9ba1-1b60093a2f65 tempest-GroupsTest-300763126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6a4add1e-7082-4aae-9ba1-1b60093a2f65 tempest-GroupsTest-300763126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:18 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6a4add1e-7082-4aae-9ba1-1b60093a2f65 tempest-GroupsTest-300763126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:18 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6a4add1e-7082-4aae-9ba1-1b60093a2f65 tempest-GroupsTest-300763126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6a4add1e-7082-4aae-9ba1-1b60093a2f65 tempest-GroupsTest-300763126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6a4add1e-7082-4aae-9ba1-1b60093a2f65 tempest-GroupsTest-300763126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:18 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:12:18 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:18 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-318a9b5a-6c0b-4e7c-89bf-7defec113d20 tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff 1G" returned: 0 in 0.727s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-318a9b5a-6c0b-4e7c-89bf-7defec113d20 tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:19 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff Sep 25 17:12:19 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:19 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6a4add1e-7082-4aae-9ba1-1b60093a2f65 tempest-GroupsTest-300763126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.354s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:19 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-6a4add1e-7082-4aae-9ba1-1b60093a2f65 tempest-GroupsTest-300763126 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:12:19 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-6a4add1e-7082-4aae-9ba1-1b60093a2f65 tempest-GroupsTest-300763126 None] Delete group completed successfully. Sep 25 17:12:19 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-225907cc-b5db-4b82-9ebb-9a9c93b1d2d4 tempest-GroupsTest-300763126 None] Created reservations ['5e89d11f-d268-4690-8452-9a1b8f71b27b'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-225907cc-b5db-4b82-9ebb-9a9c93b1d2d4 tempest-GroupsTest-300763126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-225907cc-b5db-4b82-9ebb-9a9c93b1d2d4 tempest-GroupsTest-300763126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-225907cc-b5db-4b82-9ebb-9a9c93b1d2d4 tempest-GroupsTest-300763126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-225907cc-b5db-4b82-9ebb-9a9c93b1d2d4 tempest-GroupsTest-300763126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-225907cc-b5db-4b82-9ebb-9a9c93b1d2d4 tempest-GroupsTest-300763126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-225907cc-b5db-4b82-9ebb-9a9c93b1d2d4 tempest-GroupsTest-300763126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:19 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:12:19 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:19 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-318a9b5a-6c0b-4e7c-89bf-7defec113d20 tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff" returned: 0 in 0.504s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:19 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-318a9b5a-6c0b-4e7c-89bf-7defec113d20 tempest-VolumesSnapshotListTestJSON-1308193248 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff is being set with open permissions: ugo+rw Sep 25 17:12:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-318a9b5a-6c0b-4e7c-89bf-7defec113d20 tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:19 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff Sep 25 17:12:19 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:19 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-225907cc-b5db-4b82-9ebb-9a9c93b1d2d4 tempest-GroupsTest-300763126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.391s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:19 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-225907cc-b5db-4b82-9ebb-9a9c93b1d2d4 tempest-GroupsTest-300763126 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:12:19 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-225907cc-b5db-4b82-9ebb-9a9c93b1d2d4 tempest-GroupsTest-300763126 None] Delete group completed successfully. Sep 25 17:12:19 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-318a9b5a-6c0b-4e7c-89bf-7defec113d20 tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff" returned: 0 in 0.370s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-318a9b5a-6c0b-4e7c-89bf-7defec113d20 tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:19 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.info Sep 25 17:12:19 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:20 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-318a9b5a-6c0b-4e7c-89bf-7defec113d20 tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.info" returned: 0 in 0.324s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:20 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-318a9b5a-6c0b-4e7c-89bf-7defec113d20 tempest-VolumesSnapshotListTestJSON-1308193248 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.info is being set with open permissions: ugo+rw Sep 25 17:12:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-318a9b5a-6c0b-4e7c-89bf-7defec113d20 tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:20 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.info Sep 25 17:12:20 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:20 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-318a9b5a-6c0b-4e7c-89bf-7defec113d20 tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.info" returned: 0 in 0.460s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-318a9b5a-6c0b-4e7c-89bf-7defec113d20 tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.102s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:20 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-318a9b5a-6c0b-4e7c-89bf-7defec113d20 tempest-VolumesSnapshotListTestJSON-1308193248 None] Create snapshot completed successfully Sep 25 17:12:21 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-f82282bd-6d51-4221-95f7-be6d296069d6 tempest-GroupsTest-300763126 None] Group tempest-GroupsTest-Group-2090154310: creating Sep 25 17:12:21 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-f82282bd-6d51-4221-95f7-be6d296069d6 tempest-GroupsTest-300763126 None] Group tempest-GroupsTest-Group-2090154310: created successfully Sep 25 17:12:21 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-f82282bd-6d51-4221-95f7-be6d296069d6 tempest-GroupsTest-300763126 None] Create group completed successfully. Sep 25 17:12:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c5abcfb4-1775-4ddc-923d-14cec2fe7a7a tempest-VolumesSnapshotListTestJSON-1308193248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c5abcfb4-1775-4ddc-923d-14cec2fe7a7a tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:21 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-c5abcfb4-1775-4ddc-923d-14cec2fe7a7a tempest-VolumesSnapshotListTestJSON-1308193248 None] Creating offline snapshot ee96c8e4-7742-45d6-8982-6341ab5aa115 of volume 51914cd2-c64e-4bb3-a5de-e0091ca2d171 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:12:21 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50abf1b-ca48-4c2c-9080-7a8c0d368c8f]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c5abcfb4-1775-4ddc-923d-14cec2fe7a7a tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:21 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff Sep 25 17:12:21 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:21 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c5abcfb4-1775-4ddc-923d-14cec2fe7a7a tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff" returned: 0 in 0.434s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:21 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-c5abcfb4-1775-4ddc-923d-14cec2fe7a7a tempest-VolumesSnapshotListTestJSON-1308193248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:12:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c5abcfb4-1775-4ddc-923d-14cec2fe7a7a tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:21 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115 1G Sep 25 17:12:21 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:22 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c5abcfb4-1775-4ddc-923d-14cec2fe7a7a tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115 1G" returned: 0 in 0.634s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c5abcfb4-1775-4ddc-923d-14cec2fe7a7a tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:22 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115 Sep 25 17:12:22 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:22 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c5abcfb4-1775-4ddc-923d-14cec2fe7a7a tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115" returned: 0 in 0.394s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:22 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-c5abcfb4-1775-4ddc-923d-14cec2fe7a7a tempest-VolumesSnapshotListTestJSON-1308193248 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115 is being set with open permissions: ugo+rw Sep 25 17:12:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c5abcfb4-1775-4ddc-923d-14cec2fe7a7a tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:22 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115 Sep 25 17:12:22 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Flow 'volume_create_manager' (8f843dc6-670c-4996-a23e-7ca82fe5199f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0a69a6-b4e8-4ba2-96b7-7dafadd3d0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0a69a6-b4e8-4ba2-96b7-7dafadd3d0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-614937333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d08282a2-88c8-459e-a9b1-c8a1102ee926,host='devstack@QuobyteHD#QuobyteHD',id=d01b0d68-5bba-4b93-9721-678b7dbcc7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d33b4765de4463ab5e563e1ba3cf0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:23Z,use_quota=True,user_id='16a9c397d33c47a1bd721add258165f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d77f286b-d2bc-485a-88df-94bafc95decb),volume_type_id=d77f286b-d2bc-485a-88df-94bafc95decb)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bca663a-0b28-40ef-9e20-140885fe205f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bca663a-0b28-40ef-9e20-140885fe205f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (722f69fa-3d54-4bb4-9d16-59ee6ecb1221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (722f69fa-3d54-4bb4-9d16-59ee6ecb1221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd01b0d68-5bba-4b93-9721-678b7dbcc7c1', 'volume_name': 'volume-d01b0d68-5bba-4b93-9721-678b7dbcc7c1', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e1f84d-726d-4169-997c-2a815d777dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e1f84d-726d-4169-997c-2a815d777dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7484fe0d-e6fc-4e24-b47e-adc069f2f998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:23 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:23 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Volume d01b0d68-5bba-4b93-9721-678b7dbcc7c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d01b0d68-5bba-4b93-9721-678b7dbcc7c1', 'volume_size': 1} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c5abcfb4-1775-4ddc-923d-14cec2fe7a7a tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115" returned: 0 in 0.530s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c5abcfb4-1775-4ddc-923d-14cec2fe7a7a tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.061s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d08282a2-88c8-459e-a9b1-c8a1102ee926,created_at=2026-09-25T15:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-614937333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d08282a2-88c8-459e-a9b1-c8a1102ee926,host='devstack@QuobyteHD#QuobyteHD',id=d01b0d68-5bba-4b93-9721-678b7dbcc7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d33b4765de4463ab5e563e1ba3cf0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:23Z,use_quota=True,user_id='16a9c397d33c47a1bd721add258165f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d77f286b-d2bc-485a-88df-94bafc95decb),volume_type_id=d77f286b-d2bc-485a-88df-94bafc95decb)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Creating volume d01b0d68-5bba-4b93-9721-678b7dbcc7c1 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:12:23 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d01b0d68-5bba-4b93-9721-678b7dbcc7c1 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:23 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d01b0d68-5bba-4b93-9721-678b7dbcc7c1 1073741824 Sep 25 17:12:23 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:23 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-c5abcfb4-1775-4ddc-923d-14cec2fe7a7a tempest-VolumesSnapshotListTestJSON-1308193248 None] Create snapshot completed successfully Sep 25 17:12:23 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d01b0d68-5bba-4b93-9721-678b7dbcc7c1 1073741824" returned: 0 in 0.505s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d01b0d68-5bba-4b93-9721-678b7dbcc7c1 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:23 devstack sudo[96698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d01b0d68-5bba-4b93-9721-678b7dbcc7c1 Sep 25 17:12:23 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:24 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d01b0d68-5bba-4b93-9721-678b7dbcc7c1" returned: 0 in 0.324s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:12:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7484fe0d-e6fc-4e24-b47e-adc069f2f998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d01b0d68-5bba-4b93-9721-678b7dbcc7c1', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (119c5150-d962-48c5-b4c1-d5203ac0de76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:24 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Volume volume-d01b0d68-5bba-4b93-9721-678b7dbcc7c1 (d01b0d68-5bba-4b93-9721-678b7dbcc7c1): created successfully Sep 25 17:12:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (119c5150-d962-48c5-b4c1-d5203ac0de76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Flow 'volume_create_manager' (8f843dc6-670c-4996-a23e-7ca82fe5199f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:24 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-1bf3d8e8-e4d4-4741-a140-04b488e900aa tempest-GroupsTest-300763126 None] Created volume successfully. Sep 25 17:12:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5fd44192-8b9f-4fbd-ae80-0d76850326b8 tempest-VolumesSnapshotListTestJSON-1308193248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5fd44192-8b9f-4fbd-ae80-0d76850326b8 tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-5fd44192-8b9f-4fbd-ae80-0d76850326b8 tempest-VolumesSnapshotListTestJSON-1308193248 None] Creating offline snapshot da5aec7e-c763-4abb-849a-6be36cc66c30 of volume 51914cd2-c64e-4bb3-a5de-e0091ca2d171 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:12:24 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[13646fe3-0fdc-435a-84ec-4379a9e88f4e]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5fd44192-8b9f-4fbd-ae80-0d76850326b8 tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:24 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115 Sep 25 17:12:24 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:25 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5fd44192-8b9f-4fbd-ae80-0d76850326b8 tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115" returned: 0 in 0.500s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:25 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-5fd44192-8b9f-4fbd-ae80-0d76850326b8 tempest-VolumesSnapshotListTestJSON-1308193248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:12:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5fd44192-8b9f-4fbd-ae80-0d76850326b8 tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.da5aec7e-c763-4abb-849a-6be36cc66c30 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:25 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.da5aec7e-c763-4abb-849a-6be36cc66c30 1G Sep 25 17:12:25 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:26 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5fd44192-8b9f-4fbd-ae80-0d76850326b8 tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.da5aec7e-c763-4abb-849a-6be36cc66c30 1G" returned: 0 in 0.746s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5fd44192-8b9f-4fbd-ae80-0d76850326b8 tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.da5aec7e-c763-4abb-849a-6be36cc66c30 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:26 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.da5aec7e-c763-4abb-849a-6be36cc66c30 Sep 25 17:12:26 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Flow 'volume_create_manager' (a6cc930c-6e3a-4762-b2b3-3d0321ed5b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f793a55b-6dd1-4098-9ecd-692a8bfdbbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f793a55b-6dd1-4098-9ecd-692a8bfdbbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-27999937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d08282a2-88c8-459e-a9b1-c8a1102ee926,host='devstack@QuobyteHD#QuobyteHD',id=424cc49f-eae2-4921-8eff-2f169f19e1cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d33b4765de4463ab5e563e1ba3cf0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:26Z,use_quota=True,user_id='16a9c397d33c47a1bd721add258165f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d77f286b-d2bc-485a-88df-94bafc95decb),volume_type_id=d77f286b-d2bc-485a-88df-94bafc95decb)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8dd93c6-72c5-4f39-8579-eab13466d993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8dd93c6-72c5-4f39-8579-eab13466d993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a88cd19-725d-40cc-87d5-e951cbb17e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a88cd19-725d-40cc-87d5-e951cbb17e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '424cc49f-eae2-4921-8eff-2f169f19e1cb', 'volume_name': 'volume-424cc49f-eae2-4921-8eff-2f169f19e1cb', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630f8d60-d867-4cbf-a5a9-d50193b928e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630f8d60-d867-4cbf-a5a9-d50193b928e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49eaa241-0f0f-4f0b-abbf-432d009615d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:26 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Volume 424cc49f-eae2-4921-8eff-2f169f19e1cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-424cc49f-eae2-4921-8eff-2f169f19e1cb', 'volume_size': 1} Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:26 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5fd44192-8b9f-4fbd-ae80-0d76850326b8 tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.da5aec7e-c763-4abb-849a-6be36cc66c30" returned: 0 in 0.555s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:26 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-5fd44192-8b9f-4fbd-ae80-0d76850326b8 tempest-VolumesSnapshotListTestJSON-1308193248 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.da5aec7e-c763-4abb-849a-6be36cc66c30 is being set with open permissions: ugo+rw Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5fd44192-8b9f-4fbd-ae80-0d76850326b8 tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.da5aec7e-c763-4abb-849a-6be36cc66c30 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:26 devstack sudo[96723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.da5aec7e-c763-4abb-849a-6be36cc66c30 Sep 25 17:12:26 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:26 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5fd44192-8b9f-4fbd-ae80-0d76850326b8 tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.da5aec7e-c763-4abb-849a-6be36cc66c30" returned: 0 in 0.272s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5fd44192-8b9f-4fbd-ae80-0d76850326b8 tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.218s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.479s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d08282a2-88c8-459e-a9b1-c8a1102ee926,created_at=2026-09-25T15:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-27999937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d08282a2-88c8-459e-a9b1-c8a1102ee926,host='devstack@QuobyteHD#QuobyteHD',id=424cc49f-eae2-4921-8eff-2f169f19e1cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d33b4765de4463ab5e563e1ba3cf0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:26Z,use_quota=True,user_id='16a9c397d33c47a1bd721add258165f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d77f286b-d2bc-485a-88df-94bafc95decb),volume_type_id=d77f286b-d2bc-485a-88df-94bafc95decb)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Creating volume 424cc49f-eae2-4921-8eff-2f169f19e1cb {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:12:26 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:12:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-424cc49f-eae2-4921-8eff-2f169f19e1cb 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:27 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-424cc49f-eae2-4921-8eff-2f169f19e1cb 1073741824 Sep 25 17:12:27 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:27 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-5fd44192-8b9f-4fbd-ae80-0d76850326b8 tempest-VolumesSnapshotListTestJSON-1308193248 None] Create snapshot completed successfully Sep 25 17:12:27 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-424cc49f-eae2-4921-8eff-2f169f19e1cb 1073741824" returned: 0 in 0.579s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-424cc49f-eae2-4921-8eff-2f169f19e1cb {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:27 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-424cc49f-eae2-4921-8eff-2f169f19e1cb Sep 25 17:12:27 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:27 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-424cc49f-eae2-4921-8eff-2f169f19e1cb" returned: 0 in 0.357s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:12:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49eaa241-0f0f-4f0b-abbf-432d009615d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-424cc49f-eae2-4921-8eff-2f169f19e1cb', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e6b2da-5d18-4671-9342-d2bf5d4b6545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:28 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Volume volume-424cc49f-eae2-4921-8eff-2f169f19e1cb (424cc49f-eae2-4921-8eff-2f169f19e1cb): created successfully Sep 25 17:12:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e6b2da-5d18-4671-9342-d2bf5d4b6545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Flow 'volume_create_manager' (a6cc930c-6e3a-4762-b2b3-3d0321ed5b3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:28 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-f07bc826-82ae-460c-b2df-06d7c1c09a14 tempest-GroupsTest-300763126 None] Created volume successfully. Sep 25 17:12:29 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-91e756c5-8aa6-4596-af56-7f447124514f tempest-GroupsTest-300763126 None] Update group completed successfully. Sep 25 17:12:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] Acquiring lock "cinder-da5aec7e-c763-4abb-849a-6be36cc66c30-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "cinder-da5aec7e-c763-4abb-849a-6be36cc66c30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] Acquiring lock "cinder-quobyte-51914cd2-c64e-4bb3-a5de-e0091ca2d171" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "cinder-quobyte-51914cd2-c64e-4bb3-a5de-e0091ca2d171" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] Acquiring lock "cinder-quobyte-da5aec7e-c763-4abb-849a-6be36cc66c30" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "cinder-quobyte-da5aec7e-c763-4abb-849a-6be36cc66c30" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:29 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] Deleting offline snapshot da5aec7e-c763-4abb-849a-6be36cc66c30 of volume 51914cd2-c64e-4bb3-a5de-e0091ca2d171 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:12:29 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] snapshot_file for this snap is: volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.da5aec7e-c763-4abb-849a-6be36cc66c30 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:12:29 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9a6b66-b2a6-4ff8-86bf-c74012f7e613]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.da5aec7e-c763-4abb-849a-6be36cc66c30 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:29 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.da5aec7e-c763-4abb-849a-6be36cc66c30 Sep 25 17:12:29 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:29 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.da5aec7e-c763-4abb-849a-6be36cc66c30" returned: 0 in 0.471s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:29 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:12:30 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[638fdfac-aa6d-4475-a077-a81685ca744b]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:30 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115 Sep 25 17:12:30 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:30 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115" returned: 0 in 0.525s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:12:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.da5aec7e-c763-4abb-849a-6be36cc66c30 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:30 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.da5aec7e-c763-4abb-849a-6be36cc66c30 Sep 25 17:12:30 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:30 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-d435be47-0478-49b4-8751-22b74cae737a tempest-GroupsTest-300763126 None] Update group completed successfully. Sep 25 17:12:31 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.da5aec7e-c763-4abb-849a-6be36cc66c30" returned: 0 in 0.658s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.da5aec7e-c763-4abb-849a-6be36cc66c30 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:31 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.da5aec7e-c763-4abb-849a-6be36cc66c30 Sep 25 17:12:31 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:31 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.da5aec7e-c763-4abb-849a-6be36cc66c30" returned: 0 in 0.339s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:31 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "cinder-quobyte-da5aec7e-c763-4abb-849a-6be36cc66c30" released by "_delete_snapshot" :: held 2.222s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:31 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "cinder-quobyte-51914cd2-c64e-4bb3-a5de-e0091ca2d171" released by "delete_snapshot" :: held 2.257s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:31 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] Created reservations ['ed364b65-cc1f-4b6c-9748-1212365c40c4', '61d1218d-3628-4e26-912d-f45b020e0f26', '8da095be-4490-4083-a0b7-0b1b005c7aca', '25a7f19e-0b90-44bb-9512-76f6f5c9db93'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:31 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] Delete snapshot completed successfully. Sep 25 17:12:31 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-24261632-9514-4b49-b58f-70332f2f9c6c tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "cinder-da5aec7e-c763-4abb-849a-6be36cc66c30-delete_snapshot" released by "delete_snapshot" :: held 2.529s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:32 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:UPDATE=138,cinder:SELECT=129,cinder:INSERT=36,cinder:DELETE=10 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:12:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Acquiring lock "cinder-quobyte-424cc49f-eae2-4921-8eff-2f169f19e1cb" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Lock "cinder-quobyte-424cc49f-eae2-4921-8eff-2f169f19e1cb" acquired by "delete_volume" :: waited 0.033s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] Acquiring lock "cinder-ee96c8e4-7742-45d6-8982-6341ab5aa115-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:32 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efcbea7-948e-4ae3-826f-6b0c056ba0b0]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-424cc49f-eae2-4921-8eff-2f169f19e1cb {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "cinder-ee96c8e4-7742-45d6-8982-6341ab5aa115-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] Acquiring lock "cinder-quobyte-51914cd2-c64e-4bb3-a5de-e0091ca2d171" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "cinder-quobyte-51914cd2-c64e-4bb3-a5de-e0091ca2d171" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] Acquiring lock "cinder-quobyte-ee96c8e4-7742-45d6-8982-6341ab5aa115" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "cinder-quobyte-ee96c8e4-7742-45d6-8982-6341ab5aa115" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] Deleting offline snapshot ee96c8e4-7742-45d6-8982-6341ab5aa115 of volume 51914cd2-c64e-4bb3-a5de-e0091ca2d171 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:12:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] snapshot_file for this snap is: volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:12:32 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9f5e4e-fd91-4cc7-9e56-edfa226db5db]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:32 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-424cc49f-eae2-4921-8eff-2f169f19e1cb Sep 25 17:12:32 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:33 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115 Sep 25 17:12:33 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:33 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-424cc49f-eae2-4921-8eff-2f169f19e1cb" returned: 0 in 0.637s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-424cc49f-eae2-4921-8eff-2f169f19e1cb {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:33 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-424cc49f-eae2-4921-8eff-2f169f19e1cb Sep 25 17:12:33 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:33 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115" returned: 0 in 0.620s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:12:33 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c162f5-d896-49b8-8795-89cce93b7537]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:33 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff Sep 25 17:12:33 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:33 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-424cc49f-eae2-4921-8eff-2f169f19e1cb" returned: 0 in 0.342s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Lock "cinder-quobyte-424cc49f-eae2-4921-8eff-2f169f19e1cb" released by "delete_volume" :: held 1.053s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Acquiring lock "cinder-quobyte-d01b0d68-5bba-4b93-9721-678b7dbcc7c1" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Lock "cinder-quobyte-d01b0d68-5bba-4b93-9721-678b7dbcc7c1" acquired by "delete_volume" :: waited 0.016s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:33 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1145454-8a74-4aa2-9819-efcf9fe4d838]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d01b0d68-5bba-4b93-9721-678b7dbcc7c1 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:33 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d01b0d68-5bba-4b93-9721-678b7dbcc7c1 Sep 25 17:12:33 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:34 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff" returned: 0 in 0.538s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:12:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:34 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115 Sep 25 17:12:34 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:34 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d01b0d68-5bba-4b93-9721-678b7dbcc7c1" returned: 0 in 0.570s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d01b0d68-5bba-4b93-9721-678b7dbcc7c1 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:34 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d01b0d68-5bba-4b93-9721-678b7dbcc7c1 Sep 25 17:12:34 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:34 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115" returned: 0 in 0.558s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:34 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115 Sep 25 17:12:34 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:34 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d01b0d68-5bba-4b93-9721-678b7dbcc7c1" returned: 0 in 0.351s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Lock "cinder-quobyte-d01b0d68-5bba-4b93-9721-678b7dbcc7c1" released by "delete_volume" :: held 1.001s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:34 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Created reservations ['a16532c9-afe5-4cbb-820f-0dd842fdf247'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:34 devstack cinder-volume[87211]: WARNING cinder.quota [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-343167143 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-343167143, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:12:34 devstack cinder-volume[87211]: WARNING cinder.quota [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-343167143 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-343167143, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:12:35 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Created reservations ['af2914f2-97d0-4847-abf1-5e5af48728c9', 'd3ce3dca-5e59-494a-86a3-eb8cb51f66f4', '77c55f3e-3fb4-4028-a4a3-61c545bfd5bc', '3d8e1dad-b9af-4ed8-8829-e74e2cd09fe8'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:35 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.ee96c8e4-7742-45d6-8982-6341ab5aa115" returned: 0 in 0.580s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:35 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Created reservations ['2a06a72c-fba4-4e87-8071-74cec0caf46a', '7cf1e256-603b-4311-8f2b-b982dad7fb6b', '73c88d46-f3b8-4bef-b263-3163318f973b', 'fcae2b62-750a-41a8-876e-32cbe15c8fe2'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "cinder-quobyte-ee96c8e4-7742-45d6-8982-6341ab5aa115" released by "_delete_snapshot" :: held 2.473s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "cinder-quobyte-51914cd2-c64e-4bb3-a5de-e0091ca2d171" released by "delete_snapshot" :: held 2.517s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:35 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] Created reservations ['81a4e83d-4152-404e-948f-725d732b9f2c', '2a43e694-8630-4f2a-919f-cc94b639d6ed', 'ca20528f-c478-4b3a-9589-bc56605f2b25', 'dcdfe876-cd37-4f99-b335-553a4d267c8d'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:35 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:35 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:35 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:12:35 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:35 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] Delete snapshot completed successfully. Sep 25 17:12:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-40061c83-dd83-4686-afcc-8ecbcd63cd31 tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "cinder-ee96c8e4-7742-45d6-8982-6341ab5aa115-delete_snapshot" released by "delete_snapshot" :: held 2.941s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:36 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.512s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:36 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:12:36 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-4bd2b5b2-6fd1-4d17-b6cb-8ebaab4fdf23 tempest-GroupsTest-300763126 None] Delete group completed successfully. Sep 25 17:12:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-870ce72b-aa60-48c9-90cd-55eddc54ec4e tempest-VolumesSnapshotListTestJSON-1308193248 None] Acquiring lock "cinder-9cd01d2d-4127-4faa-9806-75c7feeaa3ff-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-870ce72b-aa60-48c9-90cd-55eddc54ec4e tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "cinder-9cd01d2d-4127-4faa-9806-75c7feeaa3ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-870ce72b-aa60-48c9-90cd-55eddc54ec4e tempest-VolumesSnapshotListTestJSON-1308193248 None] Acquiring lock "cinder-quobyte-51914cd2-c64e-4bb3-a5de-e0091ca2d171" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-870ce72b-aa60-48c9-90cd-55eddc54ec4e tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "cinder-quobyte-51914cd2-c64e-4bb3-a5de-e0091ca2d171" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-870ce72b-aa60-48c9-90cd-55eddc54ec4e tempest-VolumesSnapshotListTestJSON-1308193248 None] Acquiring lock "cinder-quobyte-9cd01d2d-4127-4faa-9806-75c7feeaa3ff" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-870ce72b-aa60-48c9-90cd-55eddc54ec4e tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "cinder-quobyte-9cd01d2d-4127-4faa-9806-75c7feeaa3ff" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-870ce72b-aa60-48c9-90cd-55eddc54ec4e tempest-VolumesSnapshotListTestJSON-1308193248 None] Deleting offline snapshot 9cd01d2d-4127-4faa-9806-75c7feeaa3ff of volume 51914cd2-c64e-4bb3-a5de-e0091ca2d171 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:12:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-870ce72b-aa60-48c9-90cd-55eddc54ec4e tempest-VolumesSnapshotListTestJSON-1308193248 None] snapshot_file for this snap is: volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:12:36 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a1bb67-29c8-449e-bd63-cff1bcf8f1cc]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-870ce72b-aa60-48c9-90cd-55eddc54ec4e tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:36 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff Sep 25 17:12:36 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:36 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-870ce72b-aa60-48c9-90cd-55eddc54ec4e tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff" returned: 0 in 0.665s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-870ce72b-aa60-48c9-90cd-55eddc54ec4e tempest-VolumesSnapshotListTestJSON-1308193248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:12:37 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92b8643-7fe3-4e71-9654-7d29edc9577a]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-870ce72b-aa60-48c9-90cd-55eddc54ec4e tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:37 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171 Sep 25 17:12:37 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:37 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-870ce72b-aa60-48c9-90cd-55eddc54ec4e tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171" returned: 0 in 0.568s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-870ce72b-aa60-48c9-90cd-55eddc54ec4e tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:37 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff Sep 25 17:12:37 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:38 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-870ce72b-aa60-48c9-90cd-55eddc54ec4e tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff" returned: 0 in 0.588s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-870ce72b-aa60-48c9-90cd-55eddc54ec4e tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:38 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff Sep 25 17:12:38 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:38 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-870ce72b-aa60-48c9-90cd-55eddc54ec4e tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171.9cd01d2d-4127-4faa-9806-75c7feeaa3ff" returned: 0 in 0.493s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-870ce72b-aa60-48c9-90cd-55eddc54ec4e tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "cinder-quobyte-9cd01d2d-4127-4faa-9806-75c7feeaa3ff" released by "_delete_snapshot" :: held 2.510s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-870ce72b-aa60-48c9-90cd-55eddc54ec4e tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "cinder-quobyte-51914cd2-c64e-4bb3-a5de-e0091ca2d171" released by "delete_snapshot" :: held 2.542s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:38 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-870ce72b-aa60-48c9-90cd-55eddc54ec4e tempest-VolumesSnapshotListTestJSON-1308193248 None] Created reservations ['3a2fa568-6bb0-4370-9b8e-15701e0ec7e8', 'f17020bf-5a0e-4ff0-b058-807bf1c87b8d', 'e457def0-609c-4a30-8e5e-f7253b9e0b02', '76657246-8f86-46de-8170-20d95f46f04d'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:38 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-870ce72b-aa60-48c9-90cd-55eddc54ec4e tempest-VolumesSnapshotListTestJSON-1308193248 None] Delete snapshot completed successfully. Sep 25 17:12:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-870ce72b-aa60-48c9-90cd-55eddc54ec4e tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "cinder-9cd01d2d-4127-4faa-9806-75c7feeaa3ff-delete_snapshot" released by "delete_snapshot" :: held 2.784s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3b8ff79e-4c40-40f3-977e-67552c62c411 tempest-VolumesSnapshotListTestJSON-1308193248 None] Acquiring lock "cinder-51914cd2-c64e-4bb3-a5de-e0091ca2d171-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3b8ff79e-4c40-40f3-977e-67552c62c411 tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "cinder-51914cd2-c64e-4bb3-a5de-e0091ca2d171-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:39 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=109,cinder:INSERT=31,cinder:UPDATE=135,cinder:DELETE=9 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:12:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3b8ff79e-4c40-40f3-977e-67552c62c411 tempest-VolumesSnapshotListTestJSON-1308193248 None] Acquiring lock "cinder-quobyte-51914cd2-c64e-4bb3-a5de-e0091ca2d171" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3b8ff79e-4c40-40f3-977e-67552c62c411 tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "cinder-quobyte-51914cd2-c64e-4bb3-a5de-e0091ca2d171" acquired by "delete_volume" :: waited 0.031s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:39 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[909423b6-c4a0-44d7-aca0-a51b59c4043d]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3b8ff79e-4c40-40f3-977e-67552c62c411 tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:40 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171 Sep 25 17:12:40 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:40 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3b8ff79e-4c40-40f3-977e-67552c62c411 tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171" returned: 0 in 0.770s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3b8ff79e-4c40-40f3-977e-67552c62c411 tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:40 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171 Sep 25 17:12:40 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:41 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3b8ff79e-4c40-40f3-977e-67552c62c411 tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-51914cd2-c64e-4bb3-a5de-e0091ca2d171" returned: 0 in 0.376s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:41 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3b8ff79e-4c40-40f3-977e-67552c62c411 tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "cinder-quobyte-51914cd2-c64e-4bb3-a5de-e0091ca2d171" released by "delete_volume" :: held 1.259s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:41 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-3b8ff79e-4c40-40f3-977e-67552c62c411 tempest-VolumesSnapshotListTestJSON-1308193248 None] Created reservations ['2fe22f10-b0b2-4d2f-9b9d-9efd7dbacf75', '9aa5a5bf-31d0-4eb7-aac7-ab9b5c59366d', 'c7eafb9d-5621-4456-95b0-6a264b5a8fcf', '07b6b205-9c58-48d4-adaf-53d78fc0a07d'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3b8ff79e-4c40-40f3-977e-67552c62c411 tempest-VolumesSnapshotListTestJSON-1308193248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3b8ff79e-4c40-40f3-977e-67552c62c411 tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3b8ff79e-4c40-40f3-977e-67552c62c411 tempest-VolumesSnapshotListTestJSON-1308193248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3b8ff79e-4c40-40f3-977e-67552c62c411 tempest-VolumesSnapshotListTestJSON-1308193248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3b8ff79e-4c40-40f3-977e-67552c62c411 tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3b8ff79e-4c40-40f3-977e-67552c62c411 tempest-VolumesSnapshotListTestJSON-1308193248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:41 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:12:41 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:41 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3b8ff79e-4c40-40f3-977e-67552c62c411 tempest-VolumesSnapshotListTestJSON-1308193248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.415s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:41 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-3b8ff79e-4c40-40f3-977e-67552c62c411 tempest-VolumesSnapshotListTestJSON-1308193248 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:12:41 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-3b8ff79e-4c40-40f3-977e-67552c62c411 tempest-VolumesSnapshotListTestJSON-1308193248 None] Deleted volume successfully. Sep 25 17:12:41 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3b8ff79e-4c40-40f3-977e-67552c62c411 tempest-VolumesSnapshotListTestJSON-1308193248 None] Lock "cinder-51914cd2-c64e-4bb3-a5de-e0091ca2d171-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:46 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-7f22619b-6154-4982-956f-ec28a674140f tempest-GroupsV314Test-689194039 None] Group tempest-GroupsV314Test-Group-1700457244: creating Sep 25 17:12:46 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-7f22619b-6154-4982-956f-ec28a674140f tempest-GroupsV314Test-689194039 None] Group tempest-GroupsV314Test-Group-1700457244: created successfully Sep 25 17:12:46 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-7f22619b-6154-4982-956f-ec28a674140f tempest-GroupsV314Test-689194039 None] Create group completed successfully. Sep 25 17:12:48 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:12:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Flow 'volume_create_manager' (6e7408f1-df19-443b-aa48-ddfe3828a93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0077a4-788f-442a-8490-013a18a5088b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0077a4-788f-442a-8490-013a18a5088b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1220006597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f9a3bc2-d9ac-45d0-8d65-9fb37fc1e498,host='devstack@QuobyteHD#QuobyteHD',id=09e2b1a6-eac5-4c09-bbff-da0e3740cd75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f25b6b2c50d8443db02ca1e0dcaedb13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:48Z,use_quota=True,user_id='44c6d0e90ec84fa5b7553e885515208d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc79d38d-105c-43eb-9026-43c44686905e),volume_type_id=fc79d38d-105c-43eb-9026-43c44686905e)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1870d62d-32fd-4446-a479-eabab48cb028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1870d62d-32fd-4446-a479-eabab48cb028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beed3321-a4d8-4080-ac90-95b73521d328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beed3321-a4d8-4080-ac90-95b73521d328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09e2b1a6-eac5-4c09-bbff-da0e3740cd75', 'volume_name': 'volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b048a7-6924-4369-aa2c-e1491935b7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b048a7-6924-4369-aa2c-e1491935b7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2452f5c7-8afa-4a03-8a27-3e48dbc4ba2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:48 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Volume 09e2b1a6-eac5-4c09-bbff-da0e3740cd75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75', 'volume_size': 1} Sep 25 17:12:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9f9a3bc2-d9ac-45d0-8d65-9fb37fc1e498,created_at=2026-09-25T15:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1220006597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f9a3bc2-d9ac-45d0-8d65-9fb37fc1e498,host='devstack@QuobyteHD#QuobyteHD',id=09e2b1a6-eac5-4c09-bbff-da0e3740cd75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f25b6b2c50d8443db02ca1e0dcaedb13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:48Z,use_quota=True,user_id='44c6d0e90ec84fa5b7553e885515208d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc79d38d-105c-43eb-9026-43c44686905e),volume_type_id=fc79d38d-105c-43eb-9026-43c44686905e)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:12:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Creating volume 09e2b1a6-eac5-4c09-bbff-da0e3740cd75 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:12:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:12:48 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:12:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:48 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 1073741824 Sep 25 17:12:48 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:49 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 1073741824" returned: 0 in 0.670s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:49 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 Sep 25 17:12:49 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:49 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75" returned: 0 in 0.467s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:12:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2452f5c7-8afa-4a03-8a27-3e48dbc4ba2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f071e06-5bf7-4dc7-a87e-d814eda5152e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:49 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Volume volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 (09e2b1a6-eac5-4c09-bbff-da0e3740cd75): created successfully Sep 25 17:12:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f071e06-5bf7-4dc7-a87e-d814eda5152e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Flow 'volume_create_manager' (6e7408f1-df19-443b-aa48-ddfe3828a93e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:49 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-1df4e012-8ce9-4c8d-bdfd-d77831f6166d tempest-GroupsV314Test-689194039 None] Created volume successfully. Sep 25 17:12:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:51 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Cloning volume 09e2b1a6-eac5-4c09-bbff-da0e3740cd75 to volume 7bc3c699-dad6-4984-8f56-728e1037a6a3 Sep 25 17:12:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Creating offline snapshot 4d16be22-9416-4c95-bc74-3e5ee9d82952 of volume 09e2b1a6-eac5-4c09-bbff-da0e3740cd75 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:12:51 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cf6c1f-5f9a-42c4-8c9f-acd043e8e2e7]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:52 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 Sep 25 17:12:52 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:52 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75" returned: 0 in 0.557s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:52 devstack sudo[97025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952 1G Sep 25 17:12:52 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:53 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952 1G" returned: 0 in 0.508s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:53 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952 Sep 25 17:12:53 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:53 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952" returned: 0 in 0.362s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:53 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:12:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:53 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952 Sep 25 17:12:53 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:12:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:53 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:12:53 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:53 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952" returned: 0 in 0.288s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:53 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.info Sep 25 17:12:53 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:54 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.339s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:54 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:12:54 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:12:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 28 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:12:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:12:54 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.info" returned: 0 in 0.354s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:54 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:12:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:54 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.info Sep 25 17:12:54 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:54 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.info" returned: 0 in 0.271s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Acquiring lock "cinder-quobyte-7bc3c699-dad6-4984-8f56-728e1037a6a3" by "_copy_volume_from_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Lock "cinder-quobyte-7bc3c699-dad6-4984-8f56-728e1037a6a3" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] snapshot: 4d16be22-9416-4c95-bc74-3e5ee9d82952, volume: 7bc3c699-dad6-4984-8f56-728e1037a6a3, {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:12:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:54 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c1a4d6-ccf9-4682-bdd0-251bd95f7083]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:54 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952 Sep 25 17:12:54 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:55 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952" returned: 0 in 0.530s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:12:55 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1b4182-8c55-4243-9faf-b0804743b0ff]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:55 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 Sep 25 17:12:55 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:55 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75" returned: 0 in 0.469s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] will copy from snapshot at /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:12:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Creating direct copy from snapshot {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:12:55 devstack cinder-volume[87211]: DEBUG cinder.utils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Path /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7bc3c699-dad6-4984-8f56-728e1037a6a3 not found in is_blk_device check {{(pid=87211) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:12:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7bc3c699-dad6-4984-8f56-728e1037a6a3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:55 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7bc3c699-dad6-4984-8f56-728e1037a6a3 Sep 25 17:12:55 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:58 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:12:58 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Flow 'volume_create_manager' (41ecef67-e7a9-4946-a9df-ebc045ad2ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:58 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6030de6-ac0e-4283-9dbc-b18019926802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:58 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6030de6-ac0e-4283-9dbc-b18019926802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1016745764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c4f111-203a-4e78-8f01-900a4842a068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0ce0ceb9b45d89202715da58e5e79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:58Z,use_quota=True,user_id='ef1ee95a39244d2e918c9ea5ef45042f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(153a9e00-2aa5-4250-a3c4-74e788ac873f),volume_type_id=153a9e00-2aa5-4250-a3c4-74e788ac873f)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:58 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef321c1-446f-463b-98ed-0406c453f57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:58 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef321c1-446f-463b-98ed-0406c453f57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:58 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9aad42-a572-4308-a995-dcb917473603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:58 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9aad42-a572-4308-a995-dcb917473603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74c4f111-203a-4e78-8f01-900a4842a068', 'volume_name': 'volume-74c4f111-203a-4e78-8f01-900a4842a068', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:58 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db18e168-d960-44ba-a3dd-d4e5e56408a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:58 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db18e168-d960-44ba-a3dd-d4e5e56408a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:58 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91db6469-354e-4d58-8d75-6e1485a125d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:58 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Volume 74c4f111-203a-4e78-8f01-900a4842a068: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74c4f111-203a-4e78-8f01-900a4842a068', 'volume_size': 1} Sep 25 17:12:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:59 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:12:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Flow 'volume_create_manager' (094f639f-457f-46c8-b809-ea64dd22e700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a701130c-c27e-47b5-b18b-f34e332aca36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a701130c-c27e-47b5-b18b-f34e332aca36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-453304280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3956e970-7652-49f6-b6da-0c130345e60c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0ce0ceb9b45d89202715da58e5e79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:59Z,use_quota=True,user_id='ef1ee95a39244d2e918c9ea5ef45042f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d02f5940-a044-42c5-8fbd-7545b9a89ae3),volume_type_id=d02f5940-a044-42c5-8fbd-7545b9a89ae3)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c609c1da-d8cd-48f9-a6ce-36965d4b059d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c609c1da-d8cd-48f9-a6ce-36965d4b059d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7e72eb-f7e3-4b0b-be47-cdbea872fc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7e72eb-f7e3-4b0b-be47-cdbea872fc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3956e970-7652-49f6-b6da-0c130345e60c', 'volume_name': 'volume-3956e970-7652-49f6-b6da-0c130345e60c', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac8e655a-e7ad-410e-8d9b-2f15879ceffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac8e655a-e7ad-410e-8d9b-2f15879ceffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94331153-1382-465c-9b9f-bc1e7e5268b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:59 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Volume 3956e970-7652-49f6-b6da-0c130345e60c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3956e970-7652-49f6-b6da-0c130345e60c', 'volume_size': 1} Sep 25 17:12:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:00 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:13:00 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Flow 'volume_create_manager' (124b215a-c579-47ab-9f45-93f4d9b3bd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:13:00 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f91dc99-b54c-461e-9085-bf277b5fdca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f91dc99-b54c-461e-9085-bf277b5fdca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1879290825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=750b5e46-4167-4b73-b13f-44c12706aa73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0ce0ceb9b45d89202715da58e5e79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:01Z,use_quota=True,user_id='ef1ee95a39244d2e918c9ea5ef45042f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(583d8be0-263e-457f-ab80-92b49ca12f99),volume_type_id=583d8be0-263e-457f-ab80-92b49ca12f99)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee2fe2b-81ba-47c7-9c88-72b1ac3a40cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee2fe2b-81ba-47c7-9c88-72b1ac3a40cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88310a14-f21e-47b7-bb8e-4c14199f5695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:01 devstack cinder-volume[87211]: DEBUG cinder.image.glance [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Creating Keystone auth plugin from conf {{(pid=87211) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 17:13:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88310a14-f21e-47b7-bb8e-4c14199f5695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '750b5e46-4167-4b73-b13f-44c12706aa73', 'volume_name': 'volume-750b5e46-4167-4b73-b13f-44c12706aa73', 'volume_size': 1, 'image_id': '17638c4b-eed2-445b-806b-5ce00b2f01df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/17638c4b-eed2-445b-806b-5ce00b2f01df', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1991238121', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4b0ce0ceb9b45d89202715da58e5e79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '17638c4b-eed2-445b-806b-5ce00b2f01df', 'created_at': datetime.datetime(2026, 9, 25, 15, 12, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 12, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/17638c4b-eed2-445b-806b-5ce00b2f01df/file', 'properties': {}}, 'image_service': }' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b839e0db-eb36-4bd4-97a1-fd85d6554967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b839e0db-eb36-4bd4-97a1-fd85d6554967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9f68fd-99bc-4dc9-a3cf-b5c3480c4169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:01 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Volume 750b5e46-4167-4b73-b13f-44c12706aa73: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-750b5e46-4167-4b73-b13f-44c12706aa73', 'volume_size': 1, 'image_id': '17638c4b-eed2-445b-806b-5ce00b2f01df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/17638c4b-eed2-445b-806b-5ce00b2f01df', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1991238121', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4b0ce0ceb9b45d89202715da58e5e79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '17638c4b-eed2-445b-806b-5ce00b2f01df', 'created_at': datetime.datetime(2026, 9, 25, 15, 12, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 12, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/17638c4b-eed2-445b-806b-5ce00b2f01df/file', 'properties': {}}, 'image_service': } Sep 25 17:13:01 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Trying to clone 750b5e46-4167-4b73-b13f-44c12706aa73 from image 17638c4b-eed2-445b-806b-5ce00b2f01df at location (None, [{'url': 'file:///opt/stack/data/glance/images/17638c4b-eed2-445b-806b-5ce00b2f01df', 'metadata': {}}]). {{(pid=87211) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 17:13:05 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:13:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Flow 'volume_create_manager' (87b69687-6b00-440d-8e02-892983c0936f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:13:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d55764e-b3fb-48c9-b990-627b9f864268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d55764e-b3fb-48c9-b990-627b9f864268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-435611322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6696e4e-a94e-4118-818c-6eb787df7c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e4fcc8a85f44e2940bc6488db0aa75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:05Z,use_quota=True,user_id='a4083f1f19404f3dbbf294c4c5b107c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc7ebc5f-24f8-431b-bd58-ad3cded94a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc7ebc5f-24f8-431b-bd58-ad3cded94a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6415e07-4fd0-4850-a772-daa56d28d627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6415e07-4fd0-4850-a772-daa56d28d627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6696e4e-a94e-4118-818c-6eb787df7c2e', 'volume_name': 'volume-d6696e4e-a94e-4118-818c-6eb787df7c2e', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c136170-86b2-4f16-bbf0-deadf91440c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c136170-86b2-4f16-bbf0-deadf91440c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a99a80-a153-4a05-bc0a-49d53a345449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:05 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Volume d6696e4e-a94e-4118-818c-6eb787df7c2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6696e4e-a94e-4118-818c-6eb787df7c2e', 'volume_size': 1} Sep 25 17:13:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:05 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7bc3c699-dad6-4984-8f56-728e1037a6a3" returned: 0 in 10.091s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:05 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Image conversion details: src /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75, size 1024.00 MB, duration 10.09 sec, destination /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7bc3c699-dad6-4984-8f56-728e1037a6a3 {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:13:05 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Converted 1024.00 MB image at 101.47 MB/s Sep 25 17:13:05 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7bc3c699-dad6-4984-8f56-728e1037a6a3 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:13:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7bc3c699-dad6-4984-8f56-728e1037a6a3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:05 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7bc3c699-dad6-4984-8f56-728e1037a6a3 Sep 25 17:13:05 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:05 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7bc3c699-dad6-4984-8f56-728e1037a6a3" returned: 0 in 0.284s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:05 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Lock "cinder-quobyte-7bc3c699-dad6-4984-8f56-728e1037a6a3" released by "_copy_volume_from_snapshot" :: held 11.501s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:05 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Acquiring lock "cinder-quobyte-4d16be22-9416-4c95-bc74-3e5ee9d82952" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:13:05 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Lock "cinder-quobyte-4d16be22-9416-4c95-bc74-3e5ee9d82952" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:13:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Deleting offline snapshot 4d16be22-9416-4c95-bc74-3e5ee9d82952 of volume 09e2b1a6-eac5-4c09-bbff-da0e3740cd75 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:13:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] snapshot_file for this snap is: volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:13:06 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[494c01ec-dfbb-4d6e-b8e1-355f06656c55]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:13:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:06 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952 Sep 25 17:13:06 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:06 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952" returned: 0 in 0.422s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:13:06 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c935ba9-f822-4ac3-b372-603a7c905081]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:13:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:06 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 Sep 25 17:13:06 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:07 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75" returned: 0 in 0.614s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:07 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952 Sep 25 17:13:07 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_17638c4b-eed2-445b-806b-5ce00b2f01df_jt43_y2wdevstack@QuobyteHD, size 20.69 MB, duration 5.67 sec {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 17:13:07 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Image download 20.69 MB at 3.65 MB/s Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4366e1c5-652c-4fe5-8079-6797504cf459]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17638c4b-eed2-445b-806b-5ce00b2f01df_jt43_y2wdevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:07 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17638c4b-eed2-445b-806b-5ce00b2f01df_jt43_y2wdevstack@QuobyteHD Sep 25 17:13:07 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:07 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952" returned: 0 in 0.525s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:07 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952 Sep 25 17:13:07 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:07 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17638c4b-eed2-445b-806b-5ce00b2f01df_jt43_y2wdevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Temporary image 17638c4b-eed2-445b-806b-5ce00b2f01df is fetched for user ef1ee95a39244d2e918c9ea5ef45042f. {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5769ba50-e5a3-4c18-b51d-09759b716f4b]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17638c4b-eed2-445b-806b-5ce00b2f01df_jt43_y2wdevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:07 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75.4d16be22-9416-4c95-bc74-3e5ee9d82952" returned: 0 in 0.275s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Lock "cinder-quobyte-4d16be22-9416-4c95-bc74-3e5ee9d82952" released by "_delete_snapshot" :: held 1.978s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.053s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.191s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1016745764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c4f111-203a-4e78-8f01-900a4842a068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0ce0ceb9b45d89202715da58e5e79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:58Z,use_quota=True,user_id='ef1ee95a39244d2e918c9ea5ef45042f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(153a9e00-2aa5-4250-a3c4-74e788ac873f),volume_type_id=153a9e00-2aa5-4250-a3c4-74e788ac873f)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Creating volume 74c4f111-203a-4e78-8f01-900a4842a068 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:13:07 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:13:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-74c4f111-203a-4e78-8f01-900a4842a068 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:08 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17638c4b-eed2-445b-806b-5ce00b2f01df_jt43_y2wdevstack@QuobyteHD Sep 25 17:13:08 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:08 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-74c4f111-203a-4e78-8f01-900a4842a068 1073741824 Sep 25 17:13:08 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:08 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-e96a6bdc-f03c-4cde-bcdd-a564a8d1b9ea tempest-GroupsV314Test-689194039 None] Create group from source-group-9f9a3bc2-d9ac-45d0-8d65-9fb37fc1e498 completed successfully. Sep 25 17:13:08 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17638c4b-eed2-445b-806b-5ce00b2f01df_jt43_y2wdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:08 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-74c4f111-203a-4e78-8f01-900a4842a068 1073741824" returned: 0 in 0.514s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-74c4f111-203a-4e78-8f01-900a4842a068 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:08 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-74c4f111-203a-4e78-8f01-900a4842a068 Sep 25 17:13:08 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:08 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-74c4f111-203a-4e78-8f01-900a4842a068" returned: 0 in 0.290s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.222s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-453304280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3956e970-7652-49f6-b6da-0c130345e60c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0ce0ceb9b45d89202715da58e5e79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:59Z,use_quota=True,user_id='ef1ee95a39244d2e918c9ea5ef45042f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d02f5940-a044-42c5-8fbd-7545b9a89ae3),volume_type_id=d02f5940-a044-42c5-8fbd-7545b9a89ae3)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Creating volume 3956e970-7652-49f6-b6da-0c130345e60c {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:13:08 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3956e970-7652-49f6-b6da-0c130345e60c 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91db6469-354e-4d58-8d75-6e1485a125d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c4f111-203a-4e78-8f01-900a4842a068', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca1c0e8-9aab-4dc9-9522-c21902207e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:08 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3956e970-7652-49f6-b6da-0c130345e60c 1073741824 Sep 25 17:13:08 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d0daca8c-4d74-4d50-8a73-121155f4ac88 tempest-GroupsV314Test-689194039 None] Acquiring lock "cinder-quobyte-7bc3c699-dad6-4984-8f56-728e1037a6a3" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:13:08 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Volume volume-74c4f111-203a-4e78-8f01-900a4842a068 (74c4f111-203a-4e78-8f01-900a4842a068): created successfully Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca1c0e8-9aab-4dc9-9522-c21902207e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Flow 'volume_create_manager' (41ecef67-e7a9-4946-a9df-ebc045ad2ac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d0daca8c-4d74-4d50-8a73-121155f4ac88 tempest-GroupsV314Test-689194039 None] Lock "cinder-quobyte-7bc3c699-dad6-4984-8f56-728e1037a6a3" acquired by "delete_volume" :: waited 0.031s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:13:08 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-c2a278d3-fe61-476c-a273-96efaa074350 tempest-TestInstancesWithCinderVolumes-1451695703 None] Created volume successfully. Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5aef455-b2f1-4c79-b1f8-d91c975b586d]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:13:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d0daca8c-4d74-4d50-8a73-121155f4ac88 tempest-GroupsV314Test-689194039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7bc3c699-dad6-4984-8f56-728e1037a6a3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:09 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7bc3c699-dad6-4984-8f56-728e1037a6a3 Sep 25 17:13:09 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:09 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d0daca8c-4d74-4d50-8a73-121155f4ac88 tempest-GroupsV314Test-689194039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7bc3c699-dad6-4984-8f56-728e1037a6a3" returned: 0 in 0.455s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d0daca8c-4d74-4d50-8a73-121155f4ac88 tempest-GroupsV314Test-689194039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7bc3c699-dad6-4984-8f56-728e1037a6a3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:09 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3956e970-7652-49f6-b6da-0c130345e60c 1073741824" returned: 0 in 0.633s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:09 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7bc3c699-dad6-4984-8f56-728e1037a6a3 Sep 25 17:13:09 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3956e970-7652-49f6-b6da-0c130345e60c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:09 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3956e970-7652-49f6-b6da-0c130345e60c Sep 25 17:13:09 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:09 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d0daca8c-4d74-4d50-8a73-121155f4ac88 tempest-GroupsV314Test-689194039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7bc3c699-dad6-4984-8f56-728e1037a6a3" returned: 0 in 0.298s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d0daca8c-4d74-4d50-8a73-121155f4ac88 tempest-GroupsV314Test-689194039 None] Lock "cinder-quobyte-7bc3c699-dad6-4984-8f56-728e1037a6a3" released by "delete_volume" :: held 0.838s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:09 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3956e970-7652-49f6-b6da-0c130345e60c" returned: 0 in 0.322s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.423s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-435611322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6696e4e-a94e-4118-818c-6eb787df7c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e4fcc8a85f44e2940bc6488db0aa75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:05Z,use_quota=True,user_id='a4083f1f19404f3dbbf294c4c5b107c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Creating volume d6696e4e-a94e-4118-818c-6eb787df7c2e {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:13:09 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d6696e4e-a94e-4118-818c-6eb787df7c2e 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-d0daca8c-4d74-4d50-8a73-121155f4ac88 tempest-GroupsV314Test-689194039 None] Created reservations ['724e567e-c61a-4be0-a2d0-408becb46961'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94331153-1382-465c-9b9f-bc1e7e5268b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3956e970-7652-49f6-b6da-0c130345e60c', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44daada4-8fbc-47c5-9248-c4537b891ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:09 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d6696e4e-a94e-4118-818c-6eb787df7c2e 1073741824 Sep 25 17:13:09 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:09 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Volume volume-3956e970-7652-49f6-b6da-0c130345e60c (3956e970-7652-49f6-b6da-0c130345e60c): created successfully Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44daada4-8fbc-47c5-9248-c4537b891ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Flow 'volume_create_manager' (094f639f-457f-46c8-b809-ea64dd22e700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:13:09 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b35bcdb9-6893-4783-9965-ae151851e6df tempest-TestInstancesWithCinderVolumes-1451695703 None] Created volume successfully. Sep 25 17:13:09 devstack cinder-volume[87211]: WARNING cinder.quota [None req-d0daca8c-4d74-4d50-8a73-121155f4ac88 tempest-GroupsV314Test-689194039 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1516453204 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1516453204, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:13:09 devstack cinder-volume[87211]: WARNING cinder.quota [None req-d0daca8c-4d74-4d50-8a73-121155f4ac88 tempest-GroupsV314Test-689194039 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1516453204 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1516453204, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-d0daca8c-4d74-4d50-8a73-121155f4ac88 tempest-GroupsV314Test-689194039 None] Created reservations ['eb380d8a-2bc1-4fb7-b947-06f0caf55e58', '91f1b7df-4bd6-46b8-b7ce-8a2a4004ee20', '956831b0-5528-48b3-a2ca-93c5546af4ce', '1c52ad8e-cff0-4da2-a22c-dc3c68cf7ab1'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d0daca8c-4d74-4d50-8a73-121155f4ac88 tempest-GroupsV314Test-689194039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d0daca8c-4d74-4d50-8a73-121155f4ac88 tempest-GroupsV314Test-689194039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d0daca8c-4d74-4d50-8a73-121155f4ac88 tempest-GroupsV314Test-689194039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d0daca8c-4d74-4d50-8a73-121155f4ac88 tempest-GroupsV314Test-689194039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d0daca8c-4d74-4d50-8a73-121155f4ac88 tempest-GroupsV314Test-689194039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d0daca8c-4d74-4d50-8a73-121155f4ac88 tempest-GroupsV314Test-689194039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:10 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:13:10 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:10 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d0daca8c-4d74-4d50-8a73-121155f4ac88 tempest-GroupsV314Test-689194039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.327s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-d0daca8c-4d74-4d50-8a73-121155f4ac88 tempest-GroupsV314Test-689194039 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:13:10 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-d0daca8c-4d74-4d50-8a73-121155f4ac88 tempest-GroupsV314Test-689194039 None] Delete group completed successfully. Sep 25 17:13:10 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d6696e4e-a94e-4118-818c-6eb787df7c2e 1073741824" returned: 0 in 0.786s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d6696e4e-a94e-4118-818c-6eb787df7c2e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:10 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d6696e4e-a94e-4118-818c-6eb787df7c2e Sep 25 17:13:10 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:10 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d6696e4e-a94e-4118-818c-6eb787df7c2e" returned: 0 in 0.264s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.723s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1879290825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=750b5e46-4167-4b73-b13f-44c12706aa73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0ce0ceb9b45d89202715da58e5e79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:01Z,use_quota=True,user_id='ef1ee95a39244d2e918c9ea5ef45042f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(583d8be0-263e-457f-ab80-92b49ca12f99),volume_type_id=583d8be0-263e-457f-ab80-92b49ca12f99)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Creating volume 750b5e46-4167-4b73-b13f-44c12706aa73 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:13:10 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:13:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-750b5e46-4167-4b73-b13f-44c12706aa73 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a99a80-a153-4a05-bc0a-49d53a345449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6696e4e-a94e-4118-818c-6eb787df7c2e', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:11 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-750b5e46-4167-4b73-b13f-44c12706aa73 1073741824 Sep 25 17:13:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9092aa51-38e4-44ea-a177-119cdd7a2664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:11 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:11 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Volume volume-d6696e4e-a94e-4118-818c-6eb787df7c2e (d6696e4e-a94e-4118-818c-6eb787df7c2e): created successfully Sep 25 17:13:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9092aa51-38e4-44ea-a177-119cdd7a2664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Flow 'volume_create_manager' (87b69687-6b00-440d-8e02-892983c0936f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:13:11 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-ed732e81-1752-4349-9991-174c6f1b63ce tempest-AttachVolumeTestJSON-1624605778 None] Created volume successfully. Sep 25 17:13:11 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-750b5e46-4167-4b73-b13f-44c12706aa73 1073741824" returned: 0 in 0.576s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-750b5e46-4167-4b73-b13f-44c12706aa73 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:11 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-750b5e46-4167-4b73-b13f-44c12706aa73 Sep 25 17:13:11 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:11 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-331499e8-4f1d-48cd-9852-1870ebec4f92 tempest-GroupsV314Test-689194039 None] Acquiring lock "cinder-quobyte-09e2b1a6-eac5-4c09-bbff-da0e3740cd75" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:13:11 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-331499e8-4f1d-48cd-9852-1870ebec4f92 tempest-GroupsV314Test-689194039 None] Lock "cinder-quobyte-09e2b1a6-eac5-4c09-bbff-da0e3740cd75" acquired by "delete_volume" :: waited 0.023s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:13:11 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab7efaa-7ff0-4cbe-a15c-3ef59f0c671d]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:13:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-331499e8-4f1d-48cd-9852-1870ebec4f92 tempest-GroupsV314Test-689194039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:11 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 Sep 25 17:13:11 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:12 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-750b5e46-4167-4b73-b13f-44c12706aa73" returned: 0 in 0.392s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:13:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:12 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Attempting download of 17638c4b-eed2-445b-806b-5ce00b2f01df ((None, [{'url': 'file:///opt/stack/data/glance/images/17638c4b-eed2-445b-806b-5ce00b2f01df', 'metadata': {}}])) to volume 750b5e46-4167-4b73-b13f-44c12706aa73. {{(pid=87211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 17:13:12 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cf6dd2-317a-42ca-ac74-51398a513090]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:13:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_17638c4b-eed2-445b-806b-5ce00b2f01df_92ftr004 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:12 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_17638c4b-eed2-445b-806b-5ce00b2f01df_92ftr004 Sep 25 17:13:12 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:12 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-331499e8-4f1d-48cd-9852-1870ebec4f92 tempest-GroupsV314Test-689194039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75" returned: 0 in 0.693s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-331499e8-4f1d-48cd-9852-1870ebec4f92 tempest-GroupsV314Test-689194039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:12 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75 Sep 25 17:13:12 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:12 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_17638c4b-eed2-445b-806b-5ce00b2f01df_92ftr004" returned: 0 in 0.554s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17638c4b-eed2-445b-806b-5ce00b2f01df_92ftr004 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-8e317797-e443-4c4f-811c-720ace367ee8 req-c98c718f-e40b-4b15-b4f9-568ca248f65c tempest-AttachVolumeTestJSON-1624605778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-8e317797-e443-4c4f-811c-720ace367ee8 req-c98c718f-e40b-4b15-b4f9-568ca248f65c tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-8e317797-e443-4c4f-811c-720ace367ee8 req-c98c718f-e40b-4b15-b4f9-568ca248f65c tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-8e317797-e443-4c4f-811c-720ace367ee8 req-c98c718f-e40b-4b15-b4f9-568ca248f65c tempest-AttachVolumeTestJSON-1624605778 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-d6696e4e-a94e-4118-818c-6eb787df7c2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5290d3a1-a96c-4d6a-b369-331c6f938333', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:13:12 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17638c4b-eed2-445b-806b-5ce00b2f01df_92ftr004 Sep 25 17:13:12 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:12 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-8e317797-e443-4c4f-811c-720ace367ee8 req-c98c718f-e40b-4b15-b4f9-568ca248f65c tempest-AttachVolumeTestJSON-1624605778 None] attachment_update completed successfully. Sep 25 17:13:12 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-331499e8-4f1d-48cd-9852-1870ebec4f92 tempest-GroupsV314Test-689194039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-09e2b1a6-eac5-4c09-bbff-da0e3740cd75" returned: 0 in 0.513s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:13 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-331499e8-4f1d-48cd-9852-1870ebec4f92 tempest-GroupsV314Test-689194039 None] Lock "cinder-quobyte-09e2b1a6-eac5-4c09-bbff-da0e3740cd75" released by "delete_volume" :: held 1.336s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:13 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-331499e8-4f1d-48cd-9852-1870ebec4f92 tempest-GroupsV314Test-689194039 None] Created reservations ['3f611b9e-826a-46df-9311-523e896601ad'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:13:13 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17638c4b-eed2-445b-806b-5ce00b2f01df_92ftr004" returned: 1 in 0.554s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17638c4b-eed2-445b-806b-5ce00b2f01df_92ftr004' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:13:13 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc847b0b-1f72-435d-80a7-e5265e192bdb]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:13:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17638c4b-eed2-445b-806b-5ce00b2f01df_jt43_y2wdevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:13 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-331499e8-4f1d-48cd-9852-1870ebec4f92 tempest-GroupsV314Test-689194039 None] Created reservations ['e0f27e9a-0dc5-48e8-a050-7e28d96b524f', 'ff82de7a-3787-4096-a27e-8a26da01f940', '6788d016-ed36-4772-96ef-74e9af131fc7', 'a6f133c8-f69a-40ca-9ff7-1d27cf77789d'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:13:13 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17638c4b-eed2-445b-806b-5ce00b2f01df_jt43_y2wdevstack@QuobyteHD Sep 25 17:13:13 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-331499e8-4f1d-48cd-9852-1870ebec4f92 tempest-GroupsV314Test-689194039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-331499e8-4f1d-48cd-9852-1870ebec4f92 tempest-GroupsV314Test-689194039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-331499e8-4f1d-48cd-9852-1870ebec4f92 tempest-GroupsV314Test-689194039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-331499e8-4f1d-48cd-9852-1870ebec4f92 tempest-GroupsV314Test-689194039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-331499e8-4f1d-48cd-9852-1870ebec4f92 tempest-GroupsV314Test-689194039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-331499e8-4f1d-48cd-9852-1870ebec4f92 tempest-GroupsV314Test-689194039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:13 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:13:13 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:13 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17638c4b-eed2-445b-806b-5ce00b2f01df_jt43_y2wdevstack@QuobyteHD" returned: 0 in 0.517s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:13 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] 17638c4b-eed2-445b-806b-5ce00b2f01df was qcow2, converting to qcow2 {{(pid=87211) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 17:13:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_17638c4b-eed2-445b-806b-5ce00b2f01df_jt43_y2wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-750b5e46-4167-4b73-b13f-44c12706aa73 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:13 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_17638c4b-eed2-445b-806b-5ce00b2f01df_jt43_y2wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-750b5e46-4167-4b73-b13f-44c12706aa73 Sep 25 17:13:13 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:13 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-331499e8-4f1d-48cd-9852-1870ebec4f92 tempest-GroupsV314Test-689194039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.380s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:13 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-331499e8-4f1d-48cd-9852-1870ebec4f92 tempest-GroupsV314Test-689194039 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:13:13 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-331499e8-4f1d-48cd-9852-1870ebec4f92 tempest-GroupsV314Test-689194039 None] Delete group completed successfully. Sep 25 17:13:16 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:13:16 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Flow 'volume_create_manager' (ada627e7-2738-428b-b77a-b6c4c9bbb8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:13:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdcca1e-bdd4-4fb7-bff9-eca61bbdf7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_17638c4b-eed2-445b-806b-5ce00b2f01df_jt43_y2wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-750b5e46-4167-4b73-b13f-44c12706aa73" returned: 0 in 3.122s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:16 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_17638c4b-eed2-445b-806b-5ce00b2f01df_jt43_y2wdevstack@QuobyteHD, size 112.00 MB, duration 3.12 sec, destination /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-750b5e46-4167-4b73-b13f-44c12706aa73 {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:13:16 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Converted 112.00 MB image at 35.87 MB/s Sep 25 17:13:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-750b5e46-4167-4b73-b13f-44c12706aa73 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdcca1e-bdd4-4fb7-bff9-eca61bbdf7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1851934110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3d6c29-ed60-42f5-b97e-0f941bda41b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e4fcc8a85f44e2940bc6488db0aa75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:17Z,use_quota=True,user_id='a4083f1f19404f3dbbf294c4c5b107c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:16 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-750b5e46-4167-4b73-b13f-44c12706aa73 1G Sep 25 17:13:16 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf121d24-7807-4a42-ae37-55668a725fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf121d24-7807-4a42-ae37-55668a725fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a83e2f-f19f-4455-91e2-0be58cace469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a83e2f-f19f-4455-91e2-0be58cace469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d3d6c29-ed60-42f5-b97e-0f941bda41b2', 'volume_name': 'volume-2d3d6c29-ed60-42f5-b97e-0f941bda41b2', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28163999-f786-424c-98b7-9a8ae4a2ad48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28163999-f786-424c-98b7-9a8ae4a2ad48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34f341f-fe82-4dce-9df2-122164e7b593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:17 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Volume 2d3d6c29-ed60-42f5-b97e-0f941bda41b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d3d6c29-ed60-42f5-b97e-0f941bda41b2', 'volume_size': 1} Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1851934110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3d6c29-ed60-42f5-b97e-0f941bda41b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e4fcc8a85f44e2940bc6488db0aa75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:17Z,use_quota=True,user_id='a4083f1f19404f3dbbf294c4c5b107c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Creating volume 2d3d6c29-ed60-42f5-b97e-0f941bda41b2 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:13:17 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2d3d6c29-ed60-42f5-b97e-0f941bda41b2 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:17 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2d3d6c29-ed60-42f5-b97e-0f941bda41b2 1073741824 Sep 25 17:13:17 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:17 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-750b5e46-4167-4b73-b13f-44c12706aa73 1G" returned: 0 in 0.506s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Downloaded image 17638c4b-eed2-445b-806b-5ce00b2f01df ((None, [{'url': 'file:///opt/stack/data/glance/images/17638c4b-eed2-445b-806b-5ce00b2f01df', 'metadata': {}}])) to volume 750b5e46-4167-4b73-b13f-44c12706aa73 successfully. {{(pid=87211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Temporary image 17638c4b-eed2-445b-806b-5ce00b2f01df for user ef1ee95a39244d2e918c9ea5ef45042f is deleted. {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Marking volume 750b5e46-4167-4b73-b13f-44c12706aa73 as bootable. {{(pid=87211) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Copying metadata from image 17638c4b-eed2-445b-806b-5ce00b2f01df to 750b5e46-4167-4b73-b13f-44c12706aa73. {{(pid=87211) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Creating volume glance metadata for volume 750b5e46-4167-4b73-b13f-44c12706aa73 backed by image 17638c4b-eed2-445b-806b-5ce00b2f01df with: {'image_id': '17638c4b-eed2-445b-806b-5ce00b2f01df', 'image_name': 'tempest-scenario-img--1991238121', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87211) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9f68fd-99bc-4dc9-a3cf-b5c3480c4169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-750b5e46-4167-4b73-b13f-44c12706aa73', 'volume_size': 1, 'image_id': '17638c4b-eed2-445b-806b-5ce00b2f01df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/17638c4b-eed2-445b-806b-5ce00b2f01df', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1991238121', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4b0ce0ceb9b45d89202715da58e5e79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '17638c4b-eed2-445b-806b-5ce00b2f01df', 'created_at': datetime.datetime(2026, 9, 25, 15, 12, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 12, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/17638c4b-eed2-445b-806b-5ce00b2f01df/file', 'properties': {}}, 'image_service': }' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29412398-1d8a-446c-8c0a-f8bca2853ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:17 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Volume volume-750b5e46-4167-4b73-b13f-44c12706aa73 (750b5e46-4167-4b73-b13f-44c12706aa73): created successfully Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29412398-1d8a-446c-8c0a-f8bca2853ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Flow 'volume_create_manager' (124b215a-c579-47ab-9f45-93f4d9b3bd4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:13:17 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-170fffe5-8c0f-4ded-b807-dd5bac57d3dc tempest-TestInstancesWithCinderVolumes-1451695703 None] Created volume successfully. Sep 25 17:13:17 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2d3d6c29-ed60-42f5-b97e-0f941bda41b2 1073741824" returned: 0 in 0.712s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2d3d6c29-ed60-42f5-b97e-0f941bda41b2 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:17 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2d3d6c29-ed60-42f5-b97e-0f941bda41b2 Sep 25 17:13:17 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:18 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2d3d6c29-ed60-42f5-b97e-0f941bda41b2" returned: 0 in 0.329s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:18 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:13:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:18 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34f341f-fe82-4dce-9df2-122164e7b593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d3d6c29-ed60-42f5-b97e-0f941bda41b2', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:18 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20923c61-f996-4bc0-aabf-3baaaa8c9a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:18 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Volume volume-2d3d6c29-ed60-42f5-b97e-0f941bda41b2 (2d3d6c29-ed60-42f5-b97e-0f941bda41b2): created successfully Sep 25 17:13:18 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20923c61-f996-4bc0-aabf-3baaaa8c9a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:18 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Flow 'volume_create_manager' (ada627e7-2738-428b-b77a-b6c4c9bbb8cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:13:18 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-afe53f0e-bf5b-484d-8ad5-3f88119d8d73 tempest-AttachVolumeTestJSON-1624605778 None] Created volume successfully. Sep 25 17:13:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-f4a908f0-c83e-47e3-9231-e6f969b8a32a req-91874f45-f820-4587-b993-d7e9acbb193b tempest-AttachVolumeTestJSON-1624605778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-f4a908f0-c83e-47e3-9231-e6f969b8a32a req-91874f45-f820-4587-b993-d7e9acbb193b tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-f4a908f0-c83e-47e3-9231-e6f969b8a32a req-91874f45-f820-4587-b993-d7e9acbb193b tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-f4a908f0-c83e-47e3-9231-e6f969b8a32a req-91874f45-f820-4587-b993-d7e9acbb193b tempest-AttachVolumeTestJSON-1624605778 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-2d3d6c29-ed60-42f5-b97e-0f941bda41b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b892c2e-4ed2-4d89-9cee-35886cd6fc77', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:13:20 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-f4a908f0-c83e-47e3-9231-e6f969b8a32a req-91874f45-f820-4587-b993-d7e9acbb193b tempest-AttachVolumeTestJSON-1624605778 None] attachment_update completed successfully. Sep 25 17:13:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-96b71e85-b367-487b-a9d6-d713734f0f58 req-6f6f736d-0a86-4678-964d-0b940f1ba4ce tempest-TestInstancesWithCinderVolumes-1451695703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-96b71e85-b367-487b-a9d6-d713734f0f58 req-6f6f736d-0a86-4678-964d-0b940f1ba4ce tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-96b71e85-b367-487b-a9d6-d713734f0f58 req-6f6f736d-0a86-4678-964d-0b940f1ba4ce tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-96b71e85-b367-487b-a9d6-d713734f0f58 req-6f6f736d-0a86-4678-964d-0b940f1ba4ce tempest-TestInstancesWithCinderVolumes-1451695703 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-750b5e46-4167-4b73-b13f-44c12706aa73', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd414b189-5194-49dd-a2ab-a1da27f7f742', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:13:23 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-96b71e85-b367-487b-a9d6-d713734f0f58 req-6f6f736d-0a86-4678-964d-0b940f1ba4ce tempest-TestInstancesWithCinderVolumes-1451695703 None] attachment_update completed successfully. Sep 25 17:13:24 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-eacb9e39-29ad-4e0b-96ed-549bef228510 req-aed372c4-3dbc-4c91-b781-6f3685d9bae7 tempest-AttachVolumeTestJSON-1624605778 None] Terminate volume connection completed successfully. Sep 25 17:13:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-eacb9e39-29ad-4e0b-96ed-549bef228510 req-aed372c4-3dbc-4c91-b781-6f3685d9bae7 tempest-AttachVolumeTestJSON-1624605778 None] Deleting attachment 5290d3a1-a96c-4d6a-b369-331c6f938333. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:13:25 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-933a7bbc-2734-4a77-85d6-03c2a10597d8 tempest-GroupsV320Test-2111201319 None] Group tempest-GroupsV320Test-Group-1908111529: creating Sep 25 17:13:25 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-933a7bbc-2734-4a77-85d6-03c2a10597d8 tempest-GroupsV320Test-2111201319 None] Group tempest-GroupsV320Test-Group-1908111529: created successfully Sep 25 17:13:25 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-933a7bbc-2734-4a77-85d6-03c2a10597d8 tempest-GroupsV320Test-2111201319 None] Create group completed successfully. Sep 25 17:13:26 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-3289b964-6270-492a-9705-762cb0cab1b4 req-bb61130b-c7d1-4331-bd77-9466ce2460be tempest-AttachVolumeTestJSON-1624605778 None] Terminate volume connection completed successfully. Sep 25 17:13:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-3289b964-6270-492a-9705-762cb0cab1b4 req-bb61130b-c7d1-4331-bd77-9466ce2460be tempest-AttachVolumeTestJSON-1624605778 None] Deleting attachment 0b892c2e-4ed2-4d89-9cee-35886cd6fc77. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:13:27 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-7570f3a7-0ca7-42a7-8285-d2d7da964003 tempest-GroupsV320Test-2111201319 None] Created reservations ['fa2764a8-c38d-4fcf-b31a-7dafa5b330f4'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:13:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7570f3a7-0ca7-42a7-8285-d2d7da964003 tempest-GroupsV320Test-2111201319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7570f3a7-0ca7-42a7-8285-d2d7da964003 tempest-GroupsV320Test-2111201319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7570f3a7-0ca7-42a7-8285-d2d7da964003 tempest-GroupsV320Test-2111201319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7570f3a7-0ca7-42a7-8285-d2d7da964003 tempest-GroupsV320Test-2111201319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7570f3a7-0ca7-42a7-8285-d2d7da964003 tempest-GroupsV320Test-2111201319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7570f3a7-0ca7-42a7-8285-d2d7da964003 tempest-GroupsV320Test-2111201319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:27 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:13:27 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:28 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7570f3a7-0ca7-42a7-8285-d2d7da964003 tempest-GroupsV320Test-2111201319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.722s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:28 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-7570f3a7-0ca7-42a7-8285-d2d7da964003 tempest-GroupsV320Test-2111201319 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:13:28 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-7570f3a7-0ca7-42a7-8285-d2d7da964003 tempest-GroupsV320Test-2111201319 None] Delete group completed successfully. Sep 25 17:13:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-56a1e710-2860-4ed1-a006-542e049d3e78 tempest-AttachVolumeTestJSON-1624605778 None] Acquiring lock "cinder-2d3d6c29-ed60-42f5-b97e-0f941bda41b2-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:13:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-56a1e710-2860-4ed1-a006-542e049d3e78 tempest-AttachVolumeTestJSON-1624605778 None] Lock "cinder-2d3d6c29-ed60-42f5-b97e-0f941bda41b2-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:13:37 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=98,cinder:UPDATE=85,cinder:INSERT=28,cinder:DELETE=4 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:13:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-56a1e710-2860-4ed1-a006-542e049d3e78 tempest-AttachVolumeTestJSON-1624605778 None] Acquiring lock "cinder-quobyte-2d3d6c29-ed60-42f5-b97e-0f941bda41b2" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:13:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-56a1e710-2860-4ed1-a006-542e049d3e78 tempest-AttachVolumeTestJSON-1624605778 None] Lock "cinder-quobyte-2d3d6c29-ed60-42f5-b97e-0f941bda41b2" acquired by "delete_volume" :: waited 0.067s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:13:37 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb0e2b3-2f9d-43bf-8d3c-a5288c468c5e]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:13:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-56a1e710-2860-4ed1-a006-542e049d3e78 tempest-AttachVolumeTestJSON-1624605778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2d3d6c29-ed60-42f5-b97e-0f941bda41b2 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:37 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2d3d6c29-ed60-42f5-b97e-0f941bda41b2 Sep 25 17:13:37 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:38 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-56a1e710-2860-4ed1-a006-542e049d3e78 tempest-AttachVolumeTestJSON-1624605778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2d3d6c29-ed60-42f5-b97e-0f941bda41b2" returned: 0 in 0.955s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-56a1e710-2860-4ed1-a006-542e049d3e78 tempest-AttachVolumeTestJSON-1624605778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2d3d6c29-ed60-42f5-b97e-0f941bda41b2 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:38 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2d3d6c29-ed60-42f5-b97e-0f941bda41b2 Sep 25 17:13:38 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:39 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-56a1e710-2860-4ed1-a006-542e049d3e78 tempest-AttachVolumeTestJSON-1624605778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2d3d6c29-ed60-42f5-b97e-0f941bda41b2" returned: 0 in 0.952s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-56a1e710-2860-4ed1-a006-542e049d3e78 tempest-AttachVolumeTestJSON-1624605778 None] Lock "cinder-quobyte-2d3d6c29-ed60-42f5-b97e-0f941bda41b2" released by "delete_volume" :: held 2.030s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:39 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-56a1e710-2860-4ed1-a006-542e049d3e78 tempest-AttachVolumeTestJSON-1624605778 None] Created reservations ['81788609-8cbc-41c7-9578-0a93271d0aee', '3f66d595-b96e-4007-8630-58dc9ade87ce', '07adc21a-c231-4f93-a795-1e661d1ef167', '61fddf2c-7a5b-441b-8e8b-85a20e929353'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:13:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-56a1e710-2860-4ed1-a006-542e049d3e78 tempest-AttachVolumeTestJSON-1624605778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-56a1e710-2860-4ed1-a006-542e049d3e78 tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-56a1e710-2860-4ed1-a006-542e049d3e78 tempest-AttachVolumeTestJSON-1624605778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-56a1e710-2860-4ed1-a006-542e049d3e78 tempest-AttachVolumeTestJSON-1624605778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-56a1e710-2860-4ed1-a006-542e049d3e78 tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-56a1e710-2860-4ed1-a006-542e049d3e78 tempest-AttachVolumeTestJSON-1624605778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:39 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:13:39 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:40 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-56a1e710-2860-4ed1-a006-542e049d3e78 tempest-AttachVolumeTestJSON-1624605778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.477s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:40 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-56a1e710-2860-4ed1-a006-542e049d3e78 tempest-AttachVolumeTestJSON-1624605778 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:13:40 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-56a1e710-2860-4ed1-a006-542e049d3e78 tempest-AttachVolumeTestJSON-1624605778 None] Deleted volume successfully. Sep 25 17:13:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-56a1e710-2860-4ed1-a006-542e049d3e78 tempest-AttachVolumeTestJSON-1624605778 None] Lock "cinder-2d3d6c29-ed60-42f5-b97e-0f941bda41b2-delete_volume" released by "delete_volume" :: held 3.301s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:41 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0ebd8446-0a1c-400d-9200-9b15982175f6 tempest-AttachVolumeTestJSON-1624605778 None] Acquiring lock "cinder-d6696e4e-a94e-4118-818c-6eb787df7c2e-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:13:41 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0ebd8446-0a1c-400d-9200-9b15982175f6 tempest-AttachVolumeTestJSON-1624605778 None] Lock "cinder-d6696e4e-a94e-4118-818c-6eb787df7c2e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:13:41 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=79,cinder:UPDATE=73,cinder:INSERT=17,cinder:DELETE=3 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:13:41 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0ebd8446-0a1c-400d-9200-9b15982175f6 tempest-AttachVolumeTestJSON-1624605778 None] Acquiring lock "cinder-quobyte-d6696e4e-a94e-4118-818c-6eb787df7c2e" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:13:41 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0ebd8446-0a1c-400d-9200-9b15982175f6 tempest-AttachVolumeTestJSON-1624605778 None] Lock "cinder-quobyte-d6696e4e-a94e-4118-818c-6eb787df7c2e" acquired by "delete_volume" :: waited 0.056s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:13:41 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc124389-8c40-4b9f-8e4f-122b2e2479e4]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:13:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0ebd8446-0a1c-400d-9200-9b15982175f6 tempest-AttachVolumeTestJSON-1624605778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d6696e4e-a94e-4118-818c-6eb787df7c2e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:41 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d6696e4e-a94e-4118-818c-6eb787df7c2e Sep 25 17:13:41 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:42 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0ebd8446-0a1c-400d-9200-9b15982175f6 tempest-AttachVolumeTestJSON-1624605778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d6696e4e-a94e-4118-818c-6eb787df7c2e" returned: 0 in 0.712s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0ebd8446-0a1c-400d-9200-9b15982175f6 tempest-AttachVolumeTestJSON-1624605778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d6696e4e-a94e-4118-818c-6eb787df7c2e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:42 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d6696e4e-a94e-4118-818c-6eb787df7c2e Sep 25 17:13:42 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:42 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0ebd8446-0a1c-400d-9200-9b15982175f6 tempest-AttachVolumeTestJSON-1624605778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d6696e4e-a94e-4118-818c-6eb787df7c2e" returned: 0 in 0.797s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0ebd8446-0a1c-400d-9200-9b15982175f6 tempest-AttachVolumeTestJSON-1624605778 None] Lock "cinder-quobyte-d6696e4e-a94e-4118-818c-6eb787df7c2e" released by "delete_volume" :: held 1.643s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:43 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-0ebd8446-0a1c-400d-9200-9b15982175f6 tempest-AttachVolumeTestJSON-1624605778 None] Created reservations ['101c2729-de1e-40ee-ab03-41a50ebfa216', 'f8f9fc0c-8810-4d02-a79c-afa3597dacbe', '91f2463f-26f9-4a42-b06b-8bae1d3def9d', 'c614131b-97c4-40a5-aa54-4473910c7a92'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:13:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0ebd8446-0a1c-400d-9200-9b15982175f6 tempest-AttachVolumeTestJSON-1624605778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0ebd8446-0a1c-400d-9200-9b15982175f6 tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0ebd8446-0a1c-400d-9200-9b15982175f6 tempest-AttachVolumeTestJSON-1624605778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0ebd8446-0a1c-400d-9200-9b15982175f6 tempest-AttachVolumeTestJSON-1624605778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0ebd8446-0a1c-400d-9200-9b15982175f6 tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0ebd8446-0a1c-400d-9200-9b15982175f6 tempest-AttachVolumeTestJSON-1624605778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:43 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:13:43 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:43 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:13:43 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Flow 'volume_create_manager' (c394f23b-8e8a-400f-a420-718ec7a5c3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:13:43 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb17094-dc1c-4bd8-a1fc-3eb378b3fe20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:43 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb17094-dc1c-4bd8-a1fc-3eb378b3fe20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1927023161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62f0845b-dd80-4bf8-94c0-f55e923bcf7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4345b306ac364a0bae75618dc93c5aa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:44Z,use_quota=True,user_id='9068a49aac4647cc9f2c6a88f82898bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:43 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9aa2cd0-53c1-449d-a321-d95a31fd0bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:43 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9aa2cd0-53c1-449d-a321-d95a31fd0bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d60dcd-29a0-4f63-9ee8-1b866de580db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d60dcd-29a0-4f63-9ee8-1b866de580db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62f0845b-dd80-4bf8-94c0-f55e923bcf7d', 'volume_name': 'volume-62f0845b-dd80-4bf8-94c0-f55e923bcf7d', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f4d973-bd65-423d-b398-0d5d035deaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f4d973-bd65-423d-b398-0d5d035deaf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99210f2-424c-4a54-a554-7d931a83fba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:44 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Volume 62f0845b-dd80-4bf8-94c0-f55e923bcf7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62f0845b-dd80-4bf8-94c0-f55e923bcf7d', 'volume_size': 1} Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1927023161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62f0845b-dd80-4bf8-94c0-f55e923bcf7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4345b306ac364a0bae75618dc93c5aa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:44Z,use_quota=True,user_id='9068a49aac4647cc9f2c6a88f82898bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Creating volume 62f0845b-dd80-4bf8-94c0-f55e923bcf7d {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:13:44 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-62f0845b-dd80-4bf8-94c0-f55e923bcf7d 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:44 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-62f0845b-dd80-4bf8-94c0-f55e923bcf7d 1073741824 Sep 25 17:13:44 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:44 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0ebd8446-0a1c-400d-9200-9b15982175f6 tempest-AttachVolumeTestJSON-1624605778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.766s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-0ebd8446-0a1c-400d-9200-9b15982175f6 tempest-AttachVolumeTestJSON-1624605778 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:13:44 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-0ebd8446-0a1c-400d-9200-9b15982175f6 tempest-AttachVolumeTestJSON-1624605778 None] Deleted volume successfully. Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-34e9e905-5016-48f1-b662-e0bc7a18cbeb tempest-AttachVolumeTestJSON-1624605778 None] Acquiring lock "cinder-c89b62f8-d133-433e-89b6-9a51d286c8bc-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-34e9e905-5016-48f1-b662-e0bc7a18cbeb tempest-AttachVolumeTestJSON-1624605778 None] Lock "cinder-c89b62f8-d133-433e-89b6-9a51d286c8bc-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0ebd8446-0a1c-400d-9200-9b15982175f6 tempest-AttachVolumeTestJSON-1624605778 None] Lock "cinder-d6696e4e-a94e-4118-818c-6eb787df7c2e-delete_volume" released by "delete_volume" :: held 3.392s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-34e9e905-5016-48f1-b662-e0bc7a18cbeb tempest-AttachVolumeTestJSON-1624605778 None] Acquiring lock "cinder-quobyte-c89b62f8-d133-433e-89b6-9a51d286c8bc" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-34e9e905-5016-48f1-b662-e0bc7a18cbeb tempest-AttachVolumeTestJSON-1624605778 None] Lock "cinder-quobyte-c89b62f8-d133-433e-89b6-9a51d286c8bc" acquired by "delete_volume" :: waited 0.034s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5437e878-9fcf-4603-a2e8-c7124cdf8c50]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:13:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-34e9e905-5016-48f1-b662-e0bc7a18cbeb tempest-AttachVolumeTestJSON-1624605778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c89b62f8-d133-433e-89b6-9a51d286c8bc {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:45 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-62f0845b-dd80-4bf8-94c0-f55e923bcf7d 1073741824" returned: 0 in 1.019s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:45 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c89b62f8-d133-433e-89b6-9a51d286c8bc Sep 25 17:13:45 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-62f0845b-dd80-4bf8-94c0-f55e923bcf7d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:45 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-62f0845b-dd80-4bf8-94c0-f55e923bcf7d Sep 25 17:13:45 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:45 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-34e9e905-5016-48f1-b662-e0bc7a18cbeb tempest-AttachVolumeTestJSON-1624605778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c89b62f8-d133-433e-89b6-9a51d286c8bc" returned: 0 in 1.117s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-34e9e905-5016-48f1-b662-e0bc7a18cbeb tempest-AttachVolumeTestJSON-1624605778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c89b62f8-d133-433e-89b6-9a51d286c8bc {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:45 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-62f0845b-dd80-4bf8-94c0-f55e923bcf7d" returned: 0 in 0.717s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:13:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:45 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c89b62f8-d133-433e-89b6-9a51d286c8bc Sep 25 17:13:45 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99210f2-424c-4a54-a554-7d931a83fba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62f0845b-dd80-4bf8-94c0-f55e923bcf7d', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c818a5-cbe8-466d-b39f-fb6f50dc8ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:46 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Volume volume-62f0845b-dd80-4bf8-94c0-f55e923bcf7d (62f0845b-dd80-4bf8-94c0-f55e923bcf7d): created successfully Sep 25 17:13:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c818a5-cbe8-466d-b39f-fb6f50dc8ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Flow 'volume_create_manager' (c394f23b-8e8a-400f-a420-718ec7a5c3f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:13:46 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b6403797-9f5d-4d08-bd0a-e7cd63c9ffcd tempest-TestMinimumBasicScenario-735853333 None] Created volume successfully. Sep 25 17:13:46 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-34e9e905-5016-48f1-b662-e0bc7a18cbeb tempest-AttachVolumeTestJSON-1624605778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c89b62f8-d133-433e-89b6-9a51d286c8bc" returned: 0 in 0.671s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:46 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-34e9e905-5016-48f1-b662-e0bc7a18cbeb tempest-AttachVolumeTestJSON-1624605778 None] Lock "cinder-quobyte-c89b62f8-d133-433e-89b6-9a51d286c8bc" released by "delete_volume" :: held 1.893s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:46 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-34e9e905-5016-48f1-b662-e0bc7a18cbeb tempest-AttachVolumeTestJSON-1624605778 None] Created reservations ['4aa79a9e-1f9a-434d-b638-cb47b41120f4', 'b8e59106-1c21-4cfe-8e59-f529c49c4f36', '9ea6da02-4d47-4a45-85df-5d9299526221', 'c2e73030-77a7-460e-9e9d-c87ddd3f7cc6'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:13:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-34e9e905-5016-48f1-b662-e0bc7a18cbeb tempest-AttachVolumeTestJSON-1624605778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-34e9e905-5016-48f1-b662-e0bc7a18cbeb tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-34e9e905-5016-48f1-b662-e0bc7a18cbeb tempest-AttachVolumeTestJSON-1624605778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-34e9e905-5016-48f1-b662-e0bc7a18cbeb tempest-AttachVolumeTestJSON-1624605778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-34e9e905-5016-48f1-b662-e0bc7a18cbeb tempest-AttachVolumeTestJSON-1624605778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-34e9e905-5016-48f1-b662-e0bc7a18cbeb tempest-AttachVolumeTestJSON-1624605778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:47 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:13:47 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:48 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-34e9e905-5016-48f1-b662-e0bc7a18cbeb tempest-AttachVolumeTestJSON-1624605778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.902s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:48 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-34e9e905-5016-48f1-b662-e0bc7a18cbeb tempest-AttachVolumeTestJSON-1624605778 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:13:48 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-34e9e905-5016-48f1-b662-e0bc7a18cbeb tempest-AttachVolumeTestJSON-1624605778 None] Deleted volume successfully. Sep 25 17:13:48 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-34e9e905-5016-48f1-b662-e0bc7a18cbeb tempest-AttachVolumeTestJSON-1624605778 None] Lock "cinder-c89b62f8-d133-433e-89b6-9a51d286c8bc-delete_volume" released by "delete_volume" :: held 3.711s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-296188f7-2b1c-47f1-ab0d-5bf02ee0f226 req-5e6182df-8219-422d-b26a-03cc1ede91c6 tempest-TestMinimumBasicScenario-735853333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-296188f7-2b1c-47f1-ab0d-5bf02ee0f226 req-5e6182df-8219-422d-b26a-03cc1ede91c6 tempest-TestMinimumBasicScenario-735853333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-296188f7-2b1c-47f1-ab0d-5bf02ee0f226 req-5e6182df-8219-422d-b26a-03cc1ede91c6 tempest-TestMinimumBasicScenario-735853333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.053s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-296188f7-2b1c-47f1-ab0d-5bf02ee0f226 req-5e6182df-8219-422d-b26a-03cc1ede91c6 tempest-TestMinimumBasicScenario-735853333 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-62f0845b-dd80-4bf8-94c0-f55e923bcf7d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '792219ee-e27e-410d-985e-9e0b88c598d0', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:13:49 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-296188f7-2b1c-47f1-ab0d-5bf02ee0f226 req-5e6182df-8219-422d-b26a-03cc1ede91c6 tempest-TestMinimumBasicScenario-735853333 None] attachment_update completed successfully. Sep 25 17:13:50 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:13:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Flow 'volume_create_manager' (ead85111-bc22-42b8-b9df-a98e351bea6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:13:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687810b7-2741-462e-a46c-c7acb4c30e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687810b7-2741-462e-a46c-c7acb4c30e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1862183492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d0d3afe-75c8-49c1-a618-0002320ced68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769000ad74be42799523d438750b6a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:50Z,use_quota=True,user_id='8ecbe53d650d4251bca4f3ec727e6b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c7e175-f833-4313-95ce-09dbf4ab5bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c7e175-f833-4313-95ce-09dbf4ab5bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c43ebe8-46b7-4388-b10c-1d70f740fb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c43ebe8-46b7-4388-b10c-1d70f740fb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d0d3afe-75c8-49c1-a618-0002320ced68', 'volume_name': 'volume-0d0d3afe-75c8-49c1-a618-0002320ced68', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f63682-2807-4a6e-93c2-7f66067453f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f63682-2807-4a6e-93c2-7f66067453f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a9de25-6c82-49c7-9c11-f104c59e2606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:50 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Volume 0d0d3afe-75c8-49c1-a618-0002320ced68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d0d3afe-75c8-49c1-a618-0002320ced68', 'volume_size': 1} Sep 25 17:13:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1862183492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d0d3afe-75c8-49c1-a618-0002320ced68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769000ad74be42799523d438750b6a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:50Z,use_quota=True,user_id='8ecbe53d650d4251bca4f3ec727e6b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:13:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Creating volume 0d0d3afe-75c8-49c1-a618-0002320ced68 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:13:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:13:50 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:13:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d0d3afe-75c8-49c1-a618-0002320ced68 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:51 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d0d3afe-75c8-49c1-a618-0002320ced68 1073741824 Sep 25 17:13:51 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:51 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d0d3afe-75c8-49c1-a618-0002320ced68 1073741824" returned: 0 in 0.831s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d0d3afe-75c8-49c1-a618-0002320ced68 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:51 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d0d3afe-75c8-49c1-a618-0002320ced68 Sep 25 17:13:51 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:52 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d0d3afe-75c8-49c1-a618-0002320ced68" returned: 0 in 0.722s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:52 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:13:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a9de25-6c82-49c7-9c11-f104c59e2606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d0d3afe-75c8-49c1-a618-0002320ced68', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd62b8a4-4b10-4529-a669-0a85c6195697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:52 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Volume volume-0d0d3afe-75c8-49c1-a618-0002320ced68 (0d0d3afe-75c8-49c1-a618-0002320ced68): created successfully Sep 25 17:13:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd62b8a4-4b10-4529-a669-0a85c6195697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Flow 'volume_create_manager' (ead85111-bc22-42b8-b9df-a98e351bea6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:13:52 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-cf40ddc9-4876-417f-9dbd-7292316b1df0 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Created volume successfully. Sep 25 17:13:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:13:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:53 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:13:53 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7015eb5f-ca70-4448-aaf8-4c5d99cb74dc tempest-VolumeQuotasAdminTestJSON-1554135770 None] Acquiring lock "cinder-0d0d3afe-75c8-49c1-a618-0002320ced68-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:13:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7015eb5f-ca70-4448-aaf8-4c5d99cb74dc tempest-VolumeQuotasAdminTestJSON-1554135770 None] Lock "cinder-0d0d3afe-75c8-49c1-a618-0002320ced68-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:13:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7015eb5f-ca70-4448-aaf8-4c5d99cb74dc tempest-VolumeQuotasAdminTestJSON-1554135770 None] Acquiring lock "cinder-quobyte-0d0d3afe-75c8-49c1-a618-0002320ced68" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:13:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7015eb5f-ca70-4448-aaf8-4c5d99cb74dc tempest-VolumeQuotasAdminTestJSON-1554135770 None] Lock "cinder-quobyte-0d0d3afe-75c8-49c1-a618-0002320ced68" acquired by "delete_volume" :: waited 0.025s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:13:54 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[332a3c9e-35c7-4d14-a07b-31071bfffdb7]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:13:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7015eb5f-ca70-4448-aaf8-4c5d99cb74dc tempest-VolumeQuotasAdminTestJSON-1554135770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d0d3afe-75c8-49c1-a618-0002320ced68 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:54 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.766s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:54 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:13:54 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:13:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 28 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:13:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:13:54 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d0d3afe-75c8-49c1-a618-0002320ced68 Sep 25 17:13:54 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:55 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7015eb5f-ca70-4448-aaf8-4c5d99cb74dc tempest-VolumeQuotasAdminTestJSON-1554135770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d0d3afe-75c8-49c1-a618-0002320ced68" returned: 0 in 0.684s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7015eb5f-ca70-4448-aaf8-4c5d99cb74dc tempest-VolumeQuotasAdminTestJSON-1554135770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d0d3afe-75c8-49c1-a618-0002320ced68 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:55 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d0d3afe-75c8-49c1-a618-0002320ced68 Sep 25 17:13:55 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:55 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7015eb5f-ca70-4448-aaf8-4c5d99cb74dc tempest-VolumeQuotasAdminTestJSON-1554135770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d0d3afe-75c8-49c1-a618-0002320ced68" returned: 0 in 0.482s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7015eb5f-ca70-4448-aaf8-4c5d99cb74dc tempest-VolumeQuotasAdminTestJSON-1554135770 None] Lock "cinder-quobyte-0d0d3afe-75c8-49c1-a618-0002320ced68" released by "delete_volume" :: held 1.255s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:55 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-7015eb5f-ca70-4448-aaf8-4c5d99cb74dc tempest-VolumeQuotasAdminTestJSON-1554135770 None] Created reservations ['8a8cfe8e-d9c3-4059-b80f-29a62ab4d145', 'e1631f1d-6bcc-49d1-bcd0-dbdc1c50f6f2', 'd174b106-e571-4ab0-8288-4bb504a8534c', '782dd0cb-2c92-4955-9b72-f8a061bf8477'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:13:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7015eb5f-ca70-4448-aaf8-4c5d99cb74dc tempest-VolumeQuotasAdminTestJSON-1554135770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7015eb5f-ca70-4448-aaf8-4c5d99cb74dc tempest-VolumeQuotasAdminTestJSON-1554135770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7015eb5f-ca70-4448-aaf8-4c5d99cb74dc tempest-VolumeQuotasAdminTestJSON-1554135770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7015eb5f-ca70-4448-aaf8-4c5d99cb74dc tempest-VolumeQuotasAdminTestJSON-1554135770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7015eb5f-ca70-4448-aaf8-4c5d99cb74dc tempest-VolumeQuotasAdminTestJSON-1554135770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7015eb5f-ca70-4448-aaf8-4c5d99cb74dc tempest-VolumeQuotasAdminTestJSON-1554135770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:55 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:13:55 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:56 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7015eb5f-ca70-4448-aaf8-4c5d99cb74dc tempest-VolumeQuotasAdminTestJSON-1554135770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.303s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:56 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-7015eb5f-ca70-4448-aaf8-4c5d99cb74dc tempest-VolumeQuotasAdminTestJSON-1554135770 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:13:56 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-7015eb5f-ca70-4448-aaf8-4c5d99cb74dc tempest-VolumeQuotasAdminTestJSON-1554135770 None] Deleted volume successfully. Sep 25 17:13:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7015eb5f-ca70-4448-aaf8-4c5d99cb74dc tempest-VolumeQuotasAdminTestJSON-1554135770 None] Lock "cinder-0d0d3afe-75c8-49c1-a618-0002320ced68-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Flow 'volume_create_manager' (1299a5b5-7222-48bc-aabd-220fe243da39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9909985-9d6b-4246-bb6a-86224bc8859d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9909985-9d6b-4246-bb6a-86224bc8859d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1556917022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8caeb69-0c34-440c-a7bf-89d8c5e6f98e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769000ad74be42799523d438750b6a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:57Z,use_quota=True,user_id='8ecbe53d650d4251bca4f3ec727e6b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e41b67-489f-4414-a761-2ee0ba66a768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e41b67-489f-4414-a761-2ee0ba66a768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a003bb1-8a38-44ac-a187-5455cc6e133f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a003bb1-8a38-44ac-a187-5455cc6e133f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8caeb69-0c34-440c-a7bf-89d8c5e6f98e', 'volume_name': 'volume-c8caeb69-0c34-440c-a7bf-89d8c5e6f98e', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (112c6e8d-9129-42fc-91fd-092f53d4ffe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (112c6e8d-9129-42fc-91fd-092f53d4ffe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ed31e4-6aff-4cd1-8c07-db7222b6ccf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:57 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Volume c8caeb69-0c34-440c-a7bf-89d8c5e6f98e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8caeb69-0c34-440c-a7bf-89d8c5e6f98e', 'volume_size': 1} Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1556917022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8caeb69-0c34-440c-a7bf-89d8c5e6f98e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769000ad74be42799523d438750b6a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:57Z,use_quota=True,user_id='8ecbe53d650d4251bca4f3ec727e6b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Creating volume c8caeb69-0c34-440c-a7bf-89d8c5e6f98e {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:13:57 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c8caeb69-0c34-440c-a7bf-89d8c5e6f98e 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:57 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c8caeb69-0c34-440c-a7bf-89d8c5e6f98e 1073741824 Sep 25 17:13:57 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:57 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c8caeb69-0c34-440c-a7bf-89d8c5e6f98e 1073741824" returned: 0 in 0.539s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c8caeb69-0c34-440c-a7bf-89d8c5e6f98e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:57 devstack sudo[98556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c8caeb69-0c34-440c-a7bf-89d8c5e6f98e Sep 25 17:13:57 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:58 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c8caeb69-0c34-440c-a7bf-89d8c5e6f98e" returned: 0 in 0.420s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:58 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:13:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:58 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ed31e4-6aff-4cd1-8c07-db7222b6ccf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8caeb69-0c34-440c-a7bf-89d8c5e6f98e', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:58 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2254b172-e47b-489b-9811-5061d07c6677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:58 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Volume volume-c8caeb69-0c34-440c-a7bf-89d8c5e6f98e (c8caeb69-0c34-440c-a7bf-89d8c5e6f98e): created successfully Sep 25 17:13:58 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2254b172-e47b-489b-9811-5061d07c6677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:58 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Flow 'volume_create_manager' (1299a5b5-7222-48bc-aabd-220fe243da39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:13:58 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-765f0aaf-46a2-45cf-97cd-0a2ae87e1515 tempest-VolumeQuotasAdminTestJSON-1554135770 None] Created volume successfully. Sep 25 17:14:00 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-ad3bf74a-d071-4d9b-9b14-ac686324f43b tempest-VolumeQuotasAdminTestJSON-586011750 None] Transfer volume completed successfully. Sep 25 17:14:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6fd4936c-2283-4590-82b8-88ef24f56a07 tempest-VolumeQuotasAdminTestJSON-1800022976 None] Acquiring lock "cinder-c8caeb69-0c34-440c-a7bf-89d8c5e6f98e-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:14:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6fd4936c-2283-4590-82b8-88ef24f56a07 tempest-VolumeQuotasAdminTestJSON-1800022976 None] Lock "cinder-c8caeb69-0c34-440c-a7bf-89d8c5e6f98e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:14:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6fd4936c-2283-4590-82b8-88ef24f56a07 tempest-VolumeQuotasAdminTestJSON-1800022976 None] Acquiring lock "cinder-quobyte-c8caeb69-0c34-440c-a7bf-89d8c5e6f98e" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:14:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6fd4936c-2283-4590-82b8-88ef24f56a07 tempest-VolumeQuotasAdminTestJSON-1800022976 None] Lock "cinder-quobyte-c8caeb69-0c34-440c-a7bf-89d8c5e6f98e" acquired by "delete_volume" :: waited 0.025s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:14:00 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9173ec3-e465-4ada-8401-6ac96fe7ba88]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:14:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6fd4936c-2283-4590-82b8-88ef24f56a07 tempest-VolumeQuotasAdminTestJSON-1800022976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c8caeb69-0c34-440c-a7bf-89d8c5e6f98e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:00 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c8caeb69-0c34-440c-a7bf-89d8c5e6f98e Sep 25 17:14:00 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:01 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6fd4936c-2283-4590-82b8-88ef24f56a07 tempest-VolumeQuotasAdminTestJSON-1800022976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c8caeb69-0c34-440c-a7bf-89d8c5e6f98e" returned: 0 in 0.447s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6fd4936c-2283-4590-82b8-88ef24f56a07 tempest-VolumeQuotasAdminTestJSON-1800022976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c8caeb69-0c34-440c-a7bf-89d8c5e6f98e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:01 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c8caeb69-0c34-440c-a7bf-89d8c5e6f98e Sep 25 17:14:01 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:01 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6fd4936c-2283-4590-82b8-88ef24f56a07 tempest-VolumeQuotasAdminTestJSON-1800022976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c8caeb69-0c34-440c-a7bf-89d8c5e6f98e" returned: 0 in 0.337s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6fd4936c-2283-4590-82b8-88ef24f56a07 tempest-VolumeQuotasAdminTestJSON-1800022976 None] Lock "cinder-quobyte-c8caeb69-0c34-440c-a7bf-89d8c5e6f98e" released by "delete_volume" :: held 0.859s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:14:01 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-6fd4936c-2283-4590-82b8-88ef24f56a07 tempest-VolumeQuotasAdminTestJSON-1800022976 None] Created reservations ['b9702617-942a-4b60-8c3f-9d5b188c9da2', '38c50f65-b5bc-4b9d-833a-ff81c3894586', '768ecf9f-14dc-45d1-a6a3-6f5c997dd3e6', '962fb0e8-a617-4be1-8587-b3fd1159bb3c'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:14:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6fd4936c-2283-4590-82b8-88ef24f56a07 tempest-VolumeQuotasAdminTestJSON-1800022976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6fd4936c-2283-4590-82b8-88ef24f56a07 tempest-VolumeQuotasAdminTestJSON-1800022976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6fd4936c-2283-4590-82b8-88ef24f56a07 tempest-VolumeQuotasAdminTestJSON-1800022976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6fd4936c-2283-4590-82b8-88ef24f56a07 tempest-VolumeQuotasAdminTestJSON-1800022976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6fd4936c-2283-4590-82b8-88ef24f56a07 tempest-VolumeQuotasAdminTestJSON-1800022976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6fd4936c-2283-4590-82b8-88ef24f56a07 tempest-VolumeQuotasAdminTestJSON-1800022976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:01 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:14:01 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6fd4936c-2283-4590-82b8-88ef24f56a07 tempest-VolumeQuotasAdminTestJSON-1800022976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.352s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:02 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:02 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-6fd4936c-2283-4590-82b8-88ef24f56a07 tempest-VolumeQuotasAdminTestJSON-1800022976 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:14:02 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-6fd4936c-2283-4590-82b8-88ef24f56a07 tempest-VolumeQuotasAdminTestJSON-1800022976 None] Deleted volume successfully. Sep 25 17:14:02 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6fd4936c-2283-4590-82b8-88ef24f56a07 tempest-VolumeQuotasAdminTestJSON-1800022976 None] Lock "cinder-c8caeb69-0c34-440c-a7bf-89d8c5e6f98e-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:14:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-5a37a93b-5b0b-4d9f-8436-908654eebcda req-83515bec-d821-41a7-b7b3-1fbfbb13db78 tempest-TestInstancesWithCinderVolumes-1451695703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-5a37a93b-5b0b-4d9f-8436-908654eebcda req-83515bec-d821-41a7-b7b3-1fbfbb13db78 tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-5a37a93b-5b0b-4d9f-8436-908654eebcda req-83515bec-d821-41a7-b7b3-1fbfbb13db78 tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-5a37a93b-5b0b-4d9f-8436-908654eebcda req-83515bec-d821-41a7-b7b3-1fbfbb13db78 tempest-TestInstancesWithCinderVolumes-1451695703 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-74c4f111-203a-4e78-8f01-900a4842a068', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '324161e1-149b-4da0-bc5a-6f21e3a4150b', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:14:07 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-5a37a93b-5b0b-4d9f-8436-908654eebcda req-83515bec-d821-41a7-b7b3-1fbfbb13db78 tempest-TestInstancesWithCinderVolumes-1451695703 None] attachment_update completed successfully. Sep 25 17:14:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-88de3bda-089d-4ec2-8e61-2a7e50122f4a req-6cec8a71-b3e4-451d-a0fe-db97ba8fd5fa tempest-TestInstancesWithCinderVolumes-1451695703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-88de3bda-089d-4ec2-8e61-2a7e50122f4a req-6cec8a71-b3e4-451d-a0fe-db97ba8fd5fa tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-88de3bda-089d-4ec2-8e61-2a7e50122f4a req-6cec8a71-b3e4-451d-a0fe-db97ba8fd5fa tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-88de3bda-089d-4ec2-8e61-2a7e50122f4a req-6cec8a71-b3e4-451d-a0fe-db97ba8fd5fa tempest-TestInstancesWithCinderVolumes-1451695703 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-3956e970-7652-49f6-b6da-0c130345e60c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '434ca09e-fd61-4d62-a155-e6427e0db77f', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:14:11 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-88de3bda-089d-4ec2-8e61-2a7e50122f4a req-6cec8a71-b3e4-451d-a0fe-db97ba8fd5fa tempest-TestInstancesWithCinderVolumes-1451695703 None] attachment_update completed successfully. Sep 25 17:14:16 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:14:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Flow 'volume_create_manager' (2e7ed883-4544-49ba-b65b-59c1f913c8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:14:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3bd9a3-969c-45c4-a5e0-f5934032b2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3bd9a3-969c-45c4-a5e0-f5934032b2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1334705830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660d1906-6f90-4c1d-a76e-7523a5e051ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02aee9febfa2429bb0735444f8139662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:17Z,use_quota=True,user_id='48f895bf847c4dfba2e5da42866e2b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6ea90d-3303-40d2-b1b7-e54621a27022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6ea90d-3303-40d2-b1b7-e54621a27022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd736c6-24de-4fff-8cbf-f4803fe5eeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd736c6-24de-4fff-8cbf-f4803fe5eeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '660d1906-6f90-4c1d-a76e-7523a5e051ec', 'volume_name': 'volume-660d1906-6f90-4c1d-a76e-7523a5e051ec', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e136e47-fe0a-48f5-8369-7bd497debe8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e136e47-fe0a-48f5-8369-7bd497debe8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32206197-a9c1-48d5-9d29-f40733753807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:16 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Volume 660d1906-6f90-4c1d-a76e-7523a5e051ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-660d1906-6f90-4c1d-a76e-7523a5e051ec', 'volume_size': 1} Sep 25 17:14:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1334705830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660d1906-6f90-4c1d-a76e-7523a5e051ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02aee9febfa2429bb0735444f8139662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:17Z,use_quota=True,user_id='48f895bf847c4dfba2e5da42866e2b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:14:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Creating volume 660d1906-6f90-4c1d-a76e-7523a5e051ec {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:14:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:14:16 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:14:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-660d1906-6f90-4c1d-a76e-7523a5e051ec 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:16 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-660d1906-6f90-4c1d-a76e-7523a5e051ec 1073741824 Sep 25 17:14:16 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:17 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-660d1906-6f90-4c1d-a76e-7523a5e051ec 1073741824" returned: 0 in 0.766s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-660d1906-6f90-4c1d-a76e-7523a5e051ec {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:17 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-660d1906-6f90-4c1d-a76e-7523a5e051ec Sep 25 17:14:17 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:18 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-660d1906-6f90-4c1d-a76e-7523a5e051ec" returned: 0 in 0.383s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:18 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:14:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:18 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32206197-a9c1-48d5-9d29-f40733753807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-660d1906-6f90-4c1d-a76e-7523a5e051ec', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:18 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b464ab48-5b84-4e9e-a243-44a512ea8e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:18 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Volume volume-660d1906-6f90-4c1d-a76e-7523a5e051ec (660d1906-6f90-4c1d-a76e-7523a5e051ec): created successfully Sep 25 17:14:18 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b464ab48-5b84-4e9e-a243-44a512ea8e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:18 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Flow 'volume_create_manager' (2e7ed883-4544-49ba-b65b-59c1f913c8c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:14:18 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-dd5f9a40-1e4a-42d9-a9b8-d6f052091e87 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Created volume successfully. Sep 25 17:14:19 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-496b90ad-e419-42a6-a3af-d863a99cfcd5 req-8602be6a-c503-49b4-bc8d-e31ab214e7d0 tempest-TestInstancesWithCinderVolumes-1451695703 None] Terminate volume connection completed successfully. Sep 25 17:14:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-496b90ad-e419-42a6-a3af-d863a99cfcd5 req-8602be6a-c503-49b4-bc8d-e31ab214e7d0 tempest-TestInstancesWithCinderVolumes-1451695703 None] Deleting attachment 324161e1-149b-4da0-bc5a-6f21e3a4150b. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:14:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1b429466-9677-4482-9a89-7a1670ba6fa6 tempest-TestInstancesWithCinderVolumes-1451695703 None] Acquiring lock "cinder-74c4f111-203a-4e78-8f01-900a4842a068-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:14:20 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1b429466-9677-4482-9a89-7a1670ba6fa6 tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "cinder-74c4f111-203a-4e78-8f01-900a4842a068-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:14:20 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1b429466-9677-4482-9a89-7a1670ba6fa6 tempest-TestInstancesWithCinderVolumes-1451695703 None] Acquiring lock "cinder-quobyte-74c4f111-203a-4e78-8f01-900a4842a068" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:14:20 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1b429466-9677-4482-9a89-7a1670ba6fa6 tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "cinder-quobyte-74c4f111-203a-4e78-8f01-900a4842a068" acquired by "delete_volume" :: waited 0.033s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:14:20 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cd9c78-406c-4ddd-b135-13c2eb071f5a]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:14:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1b429466-9677-4482-9a89-7a1670ba6fa6 tempest-TestInstancesWithCinderVolumes-1451695703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-74c4f111-203a-4e78-8f01-900a4842a068 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:20 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-74c4f111-203a-4e78-8f01-900a4842a068 Sep 25 17:14:20 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:20 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-cbe51da1-1762-4eb5-9685-f47399346f63 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Acquiring lock "cinder-660d1906-6f90-4c1d-a76e-7523a5e051ec-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:14:20 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-cbe51da1-1762-4eb5-9685-f47399346f63 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Lock "cinder-660d1906-6f90-4c1d-a76e-7523a5e051ec-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:14:20 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-cbe51da1-1762-4eb5-9685-f47399346f63 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Acquiring lock "cinder-quobyte-660d1906-6f90-4c1d-a76e-7523a5e051ec" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:14:20 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-cbe51da1-1762-4eb5-9685-f47399346f63 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Lock "cinder-quobyte-660d1906-6f90-4c1d-a76e-7523a5e051ec" acquired by "delete_volume" :: waited 0.044s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:14:20 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f849e9-1418-44c4-bd33-25f9bb8f4762]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:14:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-cbe51da1-1762-4eb5-9685-f47399346f63 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-660d1906-6f90-4c1d-a76e-7523a5e051ec {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:20 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1b429466-9677-4482-9a89-7a1670ba6fa6 tempest-TestInstancesWithCinderVolumes-1451695703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-74c4f111-203a-4e78-8f01-900a4842a068" returned: 0 in 0.754s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1b429466-9677-4482-9a89-7a1670ba6fa6 tempest-TestInstancesWithCinderVolumes-1451695703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-74c4f111-203a-4e78-8f01-900a4842a068 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:21 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-74c4f111-203a-4e78-8f01-900a4842a068 Sep 25 17:14:21 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:21 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-660d1906-6f90-4c1d-a76e-7523a5e051ec Sep 25 17:14:21 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:21 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1b429466-9677-4482-9a89-7a1670ba6fa6 tempest-TestInstancesWithCinderVolumes-1451695703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-74c4f111-203a-4e78-8f01-900a4842a068" returned: 0 in 0.539s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1b429466-9677-4482-9a89-7a1670ba6fa6 tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "cinder-quobyte-74c4f111-203a-4e78-8f01-900a4842a068" released by "delete_volume" :: held 1.407s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:14:21 devstack cinder-volume[87211]: WARNING cinder.quota [None req-1b429466-9677-4482-9a89-7a1670ba6fa6 tempest-TestInstancesWithCinderVolumes-1451695703 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1458955369-1089314052 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1458955369-1089314052, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:14:21 devstack cinder-volume[87211]: WARNING cinder.quota [None req-1b429466-9677-4482-9a89-7a1670ba6fa6 tempest-TestInstancesWithCinderVolumes-1451695703 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1458955369-1089314052 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1458955369-1089314052, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:14:21 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-1b429466-9677-4482-9a89-7a1670ba6fa6 tempest-TestInstancesWithCinderVolumes-1451695703 None] Created reservations ['a6042c26-8d79-41bc-951c-7fa8f2d1f9a8', '9ac7d45e-cea7-4000-a138-23490dcecb97', 'aeef6723-21b8-4255-9ec9-70e47ad05a0a', '305fc10f-1a68-4e23-b10f-d653737d7df8'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:14:21 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-cbe51da1-1762-4eb5-9685-f47399346f63 tempest-VolumeQuotasNegativeTestJSON-69971186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-660d1906-6f90-4c1d-a76e-7523a5e051ec" returned: 0 in 0.868s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-cbe51da1-1762-4eb5-9685-f47399346f63 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-660d1906-6f90-4c1d-a76e-7523a5e051ec {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:21 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-660d1906-6f90-4c1d-a76e-7523a5e051ec Sep 25 17:14:21 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1b429466-9677-4482-9a89-7a1670ba6fa6 tempest-TestInstancesWithCinderVolumes-1451695703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1b429466-9677-4482-9a89-7a1670ba6fa6 tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:21 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1b429466-9677-4482-9a89-7a1670ba6fa6 tempest-TestInstancesWithCinderVolumes-1451695703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:21 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1b429466-9677-4482-9a89-7a1670ba6fa6 tempest-TestInstancesWithCinderVolumes-1451695703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1b429466-9677-4482-9a89-7a1670ba6fa6 tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1b429466-9677-4482-9a89-7a1670ba6fa6 tempest-TestInstancesWithCinderVolumes-1451695703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:21 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:14:21 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:22 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-cbe51da1-1762-4eb5-9685-f47399346f63 tempest-VolumeQuotasNegativeTestJSON-69971186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-660d1906-6f90-4c1d-a76e-7523a5e051ec" returned: 0 in 0.620s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-cbe51da1-1762-4eb5-9685-f47399346f63 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Lock "cinder-quobyte-660d1906-6f90-4c1d-a76e-7523a5e051ec" released by "delete_volume" :: held 1.588s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:14:22 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1b429466-9677-4482-9a89-7a1670ba6fa6 tempest-TestInstancesWithCinderVolumes-1451695703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.670s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:22 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-1b429466-9677-4482-9a89-7a1670ba6fa6 tempest-TestInstancesWithCinderVolumes-1451695703 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:14:22 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-1b429466-9677-4482-9a89-7a1670ba6fa6 tempest-TestInstancesWithCinderVolumes-1451695703 None] Deleted volume successfully. Sep 25 17:14:22 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-cbe51da1-1762-4eb5-9685-f47399346f63 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Created reservations ['8b4d8c19-b145-4b40-bebc-86c7e083c121', '046ee164-86a5-4b80-a603-f0cf5bdabc0f', '26f4112c-b863-47b5-b33f-46ed607bc0ea', '42f0177c-e3c3-4ab5-9377-f5579240e42d'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:14:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1b429466-9677-4482-9a89-7a1670ba6fa6 tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "cinder-74c4f111-203a-4e78-8f01-900a4842a068-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:14:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-cbe51da1-1762-4eb5-9685-f47399346f63 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-cbe51da1-1762-4eb5-9685-f47399346f63 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-cbe51da1-1762-4eb5-9685-f47399346f63 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-cbe51da1-1762-4eb5-9685-f47399346f63 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-cbe51da1-1762-4eb5-9685-f47399346f63 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-cbe51da1-1762-4eb5-9685-f47399346f63 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:22 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:14:22 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:23 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-cbe51da1-1762-4eb5-9685-f47399346f63 tempest-VolumeQuotasNegativeTestJSON-69971186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.442s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:23 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-cbe51da1-1762-4eb5-9685-f47399346f63 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:14:23 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-cbe51da1-1762-4eb5-9685-f47399346f63 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Deleted volume successfully. Sep 25 17:14:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-cbe51da1-1762-4eb5-9685-f47399346f63 tempest-VolumeQuotasNegativeTestJSON-69971186 None] Lock "cinder-660d1906-6f90-4c1d-a76e-7523a5e051ec-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:14:26 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-0d4f0fa7-4936-40c4-b6c9-4ab6f45fe1dd req-edd2a15f-11a3-49b8-ab24-6007a16208b3 tempest-TestInstancesWithCinderVolumes-1451695703 None] Terminate volume connection completed successfully. Sep 25 17:14:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-0d4f0fa7-4936-40c4-b6c9-4ab6f45fe1dd req-edd2a15f-11a3-49b8-ab24-6007a16208b3 tempest-TestInstancesWithCinderVolumes-1451695703 None] Deleting attachment 434ca09e-fd61-4d62-a155-e6427e0db77f. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:14:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3db6c265-6cc2-4d75-afdb-942ad7063f8a tempest-TestInstancesWithCinderVolumes-1451695703 None] Acquiring lock "cinder-3956e970-7652-49f6-b6da-0c130345e60c-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:14:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3db6c265-6cc2-4d75-afdb-942ad7063f8a tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "cinder-3956e970-7652-49f6-b6da-0c130345e60c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:14:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3db6c265-6cc2-4d75-afdb-942ad7063f8a tempest-TestInstancesWithCinderVolumes-1451695703 None] Acquiring lock "cinder-quobyte-3956e970-7652-49f6-b6da-0c130345e60c" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:14:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3db6c265-6cc2-4d75-afdb-942ad7063f8a tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "cinder-quobyte-3956e970-7652-49f6-b6da-0c130345e60c" acquired by "delete_volume" :: waited 0.030s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:14:28 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[29536d7e-c63d-420e-acb2-58860dbd59cc]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:14:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3db6c265-6cc2-4d75-afdb-942ad7063f8a tempest-TestInstancesWithCinderVolumes-1451695703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3956e970-7652-49f6-b6da-0c130345e60c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:28 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3956e970-7652-49f6-b6da-0c130345e60c Sep 25 17:14:28 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:29 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3db6c265-6cc2-4d75-afdb-942ad7063f8a tempest-TestInstancesWithCinderVolumes-1451695703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3956e970-7652-49f6-b6da-0c130345e60c" returned: 0 in 0.887s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3db6c265-6cc2-4d75-afdb-942ad7063f8a tempest-TestInstancesWithCinderVolumes-1451695703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3956e970-7652-49f6-b6da-0c130345e60c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:29 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3956e970-7652-49f6-b6da-0c130345e60c Sep 25 17:14:29 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:29 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3db6c265-6cc2-4d75-afdb-942ad7063f8a tempest-TestInstancesWithCinderVolumes-1451695703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3956e970-7652-49f6-b6da-0c130345e60c" returned: 0 in 0.457s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3db6c265-6cc2-4d75-afdb-942ad7063f8a tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "cinder-quobyte-3956e970-7652-49f6-b6da-0c130345e60c" released by "delete_volume" :: held 1.455s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:14:29 devstack cinder-volume[87211]: WARNING cinder.quota [None req-3db6c265-6cc2-4d75-afdb-942ad7063f8a tempest-TestInstancesWithCinderVolumes-1451695703 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1681654600-1336551034 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1681654600-1336551034, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:14:29 devstack cinder-volume[87211]: WARNING cinder.quota [None req-3db6c265-6cc2-4d75-afdb-942ad7063f8a tempest-TestInstancesWithCinderVolumes-1451695703 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1681654600-1336551034 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1681654600-1336551034, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:14:29 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-3db6c265-6cc2-4d75-afdb-942ad7063f8a tempest-TestInstancesWithCinderVolumes-1451695703 None] Created reservations ['abfc6c0d-3e43-409a-af7d-f16da53ef1f6', '584fdd7f-aa95-4e41-b7c1-98cf4f5c5b3d', '740bb7a9-4d7b-4c17-9673-a2812ae9e278', 'fc032c37-4b94-4f27-b975-b736b85e9d66'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:14:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3db6c265-6cc2-4d75-afdb-942ad7063f8a tempest-TestInstancesWithCinderVolumes-1451695703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3db6c265-6cc2-4d75-afdb-942ad7063f8a tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3db6c265-6cc2-4d75-afdb-942ad7063f8a tempest-TestInstancesWithCinderVolumes-1451695703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3db6c265-6cc2-4d75-afdb-942ad7063f8a tempest-TestInstancesWithCinderVolumes-1451695703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3db6c265-6cc2-4d75-afdb-942ad7063f8a tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3db6c265-6cc2-4d75-afdb-942ad7063f8a tempest-TestInstancesWithCinderVolumes-1451695703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:30 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:14:30 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:30 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3db6c265-6cc2-4d75-afdb-942ad7063f8a tempest-TestInstancesWithCinderVolumes-1451695703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.619s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:30 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-3db6c265-6cc2-4d75-afdb-942ad7063f8a tempest-TestInstancesWithCinderVolumes-1451695703 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:14:30 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-3db6c265-6cc2-4d75-afdb-942ad7063f8a tempest-TestInstancesWithCinderVolumes-1451695703 None] Deleted volume successfully. Sep 25 17:14:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3db6c265-6cc2-4d75-afdb-942ad7063f8a tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "cinder-3956e970-7652-49f6-b6da-0c130345e60c-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:14:36 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-0c3ab7af-cc6f-49a2-b38f-f919e3a00c15 req-c9f5f569-3827-4785-aeef-91b73185479a tempest-TestInstancesWithCinderVolumes-1451695703 None] Terminate volume connection completed successfully. Sep 25 17:14:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-0c3ab7af-cc6f-49a2-b38f-f919e3a00c15 req-c9f5f569-3827-4785-aeef-91b73185479a tempest-TestInstancesWithCinderVolumes-1451695703 None] Deleting attachment d414b189-5194-49dd-a2ab-a1da27f7f742. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Flow 'volume_create_manager' (97c017e5-2d67-4663-b2a8-e4d88683dd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0d9bc1-e981-4730-a691-796b19c238f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0d9bc1-e981-4730-a691-796b19c238f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-971432482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd549fbc-afe7-47fa-ae1e-5a0896a1e211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c732ff20bc454a809a9bd958f64eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:37Z,use_quota=True,user_id='a6b84d50094d47f8b088949bec7d2ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d92ac6e-6b48-4785-a970-b4b1ebf3c474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d92ac6e-6b48-4785-a970-b4b1ebf3c474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57a48cd-751a-49d5-8971-c3e6b42ba6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57a48cd-751a-49d5-8971-c3e6b42ba6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd549fbc-afe7-47fa-ae1e-5a0896a1e211', 'volume_name': 'volume-fd549fbc-afe7-47fa-ae1e-5a0896a1e211', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af81b30c-8989-4e0d-8547-884db496417c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af81b30c-8989-4e0d-8547-884db496417c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f7f5226-365a-4888-b871-44ef5064fa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:37 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Volume fd549fbc-afe7-47fa-ae1e-5a0896a1e211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd549fbc-afe7-47fa-ae1e-5a0896a1e211', 'volume_size': 1} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-971432482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd549fbc-afe7-47fa-ae1e-5a0896a1e211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c732ff20bc454a809a9bd958f64eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:37Z,use_quota=True,user_id='a6b84d50094d47f8b088949bec7d2ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Creating volume fd549fbc-afe7-47fa-ae1e-5a0896a1e211 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:14:37 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd549fbc-afe7-47fa-ae1e-5a0896a1e211 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:37 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd549fbc-afe7-47fa-ae1e-5a0896a1e211 1073741824 Sep 25 17:14:37 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:37 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd549fbc-afe7-47fa-ae1e-5a0896a1e211 1073741824" returned: 0 in 0.633s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=71,cinder:INSERT=16,cinder:UPDATE=87,cinder:DELETE=7 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:14:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd549fbc-afe7-47fa-ae1e-5a0896a1e211 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:37 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd549fbc-afe7-47fa-ae1e-5a0896a1e211 Sep 25 17:14:37 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:38 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd549fbc-afe7-47fa-ae1e-5a0896a1e211" returned: 0 in 0.283s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:14:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:38 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f7f5226-365a-4888-b871-44ef5064fa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd549fbc-afe7-47fa-ae1e-5a0896a1e211', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:38 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d94d5c-f088-4945-a3ae-397583773198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:38 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Volume volume-fd549fbc-afe7-47fa-ae1e-5a0896a1e211 (fd549fbc-afe7-47fa-ae1e-5a0896a1e211): created successfully Sep 25 17:14:38 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d94d5c-f088-4945-a3ae-397583773198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:38 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Flow 'volume_create_manager' (97c017e5-2d67-4663-b2a8-e4d88683dd23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:14:38 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-21c21d84-0edf-4985-91d1-d3faf48d169d tempest-VolumesListAdminTestJSON-1795099550 None] Created volume successfully. Sep 25 17:14:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eaf2a000-c734-4cc7-b766-d13133a402a2 tempest-TestInstancesWithCinderVolumes-1451695703 None] Acquiring lock "cinder-750b5e46-4167-4b73-b13f-44c12706aa73-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:14:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eaf2a000-c734-4cc7-b766-d13133a402a2 tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "cinder-750b5e46-4167-4b73-b13f-44c12706aa73-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:14:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eaf2a000-c734-4cc7-b766-d13133a402a2 tempest-TestInstancesWithCinderVolumes-1451695703 None] Acquiring lock "cinder-quobyte-750b5e46-4167-4b73-b13f-44c12706aa73" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:14:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eaf2a000-c734-4cc7-b766-d13133a402a2 tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "cinder-quobyte-750b5e46-4167-4b73-b13f-44c12706aa73" acquired by "delete_volume" :: waited 0.029s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:14:38 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[173916c0-0139-4e4c-9c44-b8f6129010fe]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:14:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eaf2a000-c734-4cc7-b766-d13133a402a2 tempest-TestInstancesWithCinderVolumes-1451695703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-750b5e46-4167-4b73-b13f-44c12706aa73 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:39 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-750b5e46-4167-4b73-b13f-44c12706aa73 Sep 25 17:14:39 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:39 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eaf2a000-c734-4cc7-b766-d13133a402a2 tempest-TestInstancesWithCinderVolumes-1451695703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-750b5e46-4167-4b73-b13f-44c12706aa73" returned: 0 in 0.470s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eaf2a000-c734-4cc7-b766-d13133a402a2 tempest-TestInstancesWithCinderVolumes-1451695703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-750b5e46-4167-4b73-b13f-44c12706aa73 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:39 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-750b5e46-4167-4b73-b13f-44c12706aa73 Sep 25 17:14:39 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:39 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eaf2a000-c734-4cc7-b766-d13133a402a2 tempest-TestInstancesWithCinderVolumes-1451695703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-750b5e46-4167-4b73-b13f-44c12706aa73" returned: 0 in 0.469s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eaf2a000-c734-4cc7-b766-d13133a402a2 tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "cinder-quobyte-750b5e46-4167-4b73-b13f-44c12706aa73" released by "delete_volume" :: held 1.017s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:14:39 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:14:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Flow 'volume_create_manager' (4b938465-528c-40d6-a6a1-1fdea7fc878e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:14:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597eeabb-f59e-463c-93fe-86bddcd449a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597eeabb-f59e-463c-93fe-86bddcd449a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-365121125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13eb08c1-a85f-4a2a-8b39-dc7a62e75079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c732ff20bc454a809a9bd958f64eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:40Z,use_quota=True,user_id='a6b84d50094d47f8b088949bec7d2ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a729e29-5397-48df-9ed5-42db5dc1032d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a729e29-5397-48df-9ed5-42db5dc1032d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0463f9a0-372f-4148-8956-d9e7b47613c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0463f9a0-372f-4148-8956-d9e7b47613c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13eb08c1-a85f-4a2a-8b39-dc7a62e75079', 'volume_name': 'volume-13eb08c1-a85f-4a2a-8b39-dc7a62e75079', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c591da4-94bd-48b6-9606-4100b7c194f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c591da4-94bd-48b6-9606-4100b7c194f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c98b910-a110-4b00-9e41-14969b33bbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:40 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Volume 13eb08c1-a85f-4a2a-8b39-dc7a62e75079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13eb08c1-a85f-4a2a-8b39-dc7a62e75079', 'volume_size': 1} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-365121125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13eb08c1-a85f-4a2a-8b39-dc7a62e75079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c732ff20bc454a809a9bd958f64eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:40Z,use_quota=True,user_id='a6b84d50094d47f8b088949bec7d2ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Creating volume 13eb08c1-a85f-4a2a-8b39-dc7a62e75079 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:14:40 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-13eb08c1-a85f-4a2a-8b39-dc7a62e75079 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:40 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-13eb08c1-a85f-4a2a-8b39-dc7a62e75079 1073741824 Sep 25 17:14:40 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:40 devstack cinder-volume[87211]: WARNING cinder.quota [None req-eaf2a000-c734-4cc7-b766-d13133a402a2 tempest-TestInstancesWithCinderVolumes-1451695703 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1009945997-365632631 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1009945997-365632631, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:14:40 devstack cinder-volume[87211]: WARNING cinder.quota [None req-eaf2a000-c734-4cc7-b766-d13133a402a2 tempest-TestInstancesWithCinderVolumes-1451695703 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1009945997-365632631 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1009945997-365632631, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-eaf2a000-c734-4cc7-b766-d13133a402a2 tempest-TestInstancesWithCinderVolumes-1451695703 None] Created reservations ['fd3e090e-7cbc-48f3-a37b-47fbe5b4dff4', 'a4fc9557-9578-41fd-aa90-91383a5c410d', '75a64a63-5121-43bf-acd7-2df32c688c51', '04abc5cc-dd7e-4ecf-91fb-f0908bfbb85f'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eaf2a000-c734-4cc7-b766-d13133a402a2 tempest-TestInstancesWithCinderVolumes-1451695703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eaf2a000-c734-4cc7-b766-d13133a402a2 tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-eaf2a000-c734-4cc7-b766-d13133a402a2 tempest-TestInstancesWithCinderVolumes-1451695703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-eaf2a000-c734-4cc7-b766-d13133a402a2 tempest-TestInstancesWithCinderVolumes-1451695703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eaf2a000-c734-4cc7-b766-d13133a402a2 tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eaf2a000-c734-4cc7-b766-d13133a402a2 tempest-TestInstancesWithCinderVolumes-1451695703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:40 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:14:40 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:40 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eaf2a000-c734-4cc7-b766-d13133a402a2 tempest-TestInstancesWithCinderVolumes-1451695703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.284s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-eaf2a000-c734-4cc7-b766-d13133a402a2 tempest-TestInstancesWithCinderVolumes-1451695703 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:14:40 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-eaf2a000-c734-4cc7-b766-d13133a402a2 tempest-TestInstancesWithCinderVolumes-1451695703 None] Deleted volume successfully. Sep 25 17:14:40 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-13eb08c1-a85f-4a2a-8b39-dc7a62e75079 1073741824" returned: 0 in 0.472s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eaf2a000-c734-4cc7-b766-d13133a402a2 tempest-TestInstancesWithCinderVolumes-1451695703 None] Lock "cinder-750b5e46-4167-4b73-b13f-44c12706aa73-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-13eb08c1-a85f-4a2a-8b39-dc7a62e75079 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:40 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-13eb08c1-a85f-4a2a-8b39-dc7a62e75079 Sep 25 17:14:40 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:40 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-13eb08c1-a85f-4a2a-8b39-dc7a62e75079" returned: 0 in 0.280s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c98b910-a110-4b00-9e41-14969b33bbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13eb08c1-a85f-4a2a-8b39-dc7a62e75079', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4cfe05c-b9d4-4861-a838-107def273986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:40 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Volume volume-13eb08c1-a85f-4a2a-8b39-dc7a62e75079 (13eb08c1-a85f-4a2a-8b39-dc7a62e75079): created successfully Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4cfe05c-b9d4-4861-a838-107def273986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Flow 'volume_create_manager' (4b938465-528c-40d6-a6a1-1fdea7fc878e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:14:40 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-6a53759c-8d0c-4f08-9c3f-da4aabb6766e tempest-VolumesListAdminTestJSON-1795099550 None] Created volume successfully. Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=77,cinder:INSERT=22,cinder:UPDATE=84,cinder:DELETE=6 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Flow 'volume_create_manager' (8f457849-8faf-4322-803a-b801766a8460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a830a4-2950-45a1-927f-06d8ad958bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a830a4-2950-45a1-927f-06d8ad958bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-756593931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ba5259-b7a1-466f-82a5-ba2a0daf0957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c732ff20bc454a809a9bd958f64eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:43Z,use_quota=True,user_id='a6b84d50094d47f8b088949bec7d2ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f9b644-e861-4821-876f-e18058b5fed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f9b644-e861-4821-876f-e18058b5fed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f6f9aa7-63bc-4aab-9eb3-4a79e3d69da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f6f9aa7-63bc-4aab-9eb3-4a79e3d69da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11ba5259-b7a1-466f-82a5-ba2a0daf0957', 'volume_name': 'volume-11ba5259-b7a1-466f-82a5-ba2a0daf0957', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703f03bc-7fa5-4521-adc5-22deb659ec35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703f03bc-7fa5-4521-adc5-22deb659ec35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb23e2d3-436d-4c6d-8583-e7b9df45a91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:42 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Volume 11ba5259-b7a1-466f-82a5-ba2a0daf0957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11ba5259-b7a1-466f-82a5-ba2a0daf0957', 'volume_size': 1} Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-756593931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ba5259-b7a1-466f-82a5-ba2a0daf0957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c732ff20bc454a809a9bd958f64eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:43Z,use_quota=True,user_id='a6b84d50094d47f8b088949bec7d2ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Creating volume 11ba5259-b7a1-466f-82a5-ba2a0daf0957 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:14:42 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:14:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-11ba5259-b7a1-466f-82a5-ba2a0daf0957 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:42 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-11ba5259-b7a1-466f-82a5-ba2a0daf0957 1073741824 Sep 25 17:14:42 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:43 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-11ba5259-b7a1-466f-82a5-ba2a0daf0957 1073741824" returned: 0 in 0.563s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-11ba5259-b7a1-466f-82a5-ba2a0daf0957 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:43 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-11ba5259-b7a1-466f-82a5-ba2a0daf0957 Sep 25 17:14:43 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:43 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-11ba5259-b7a1-466f-82a5-ba2a0daf0957" returned: 0 in 0.388s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:14:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:43 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb23e2d3-436d-4c6d-8583-e7b9df45a91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11ba5259-b7a1-466f-82a5-ba2a0daf0957', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:43 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8371001-7b3e-4cde-9f1c-2119c7e9c7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:43 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Volume volume-11ba5259-b7a1-466f-82a5-ba2a0daf0957 (11ba5259-b7a1-466f-82a5-ba2a0daf0957): created successfully Sep 25 17:14:43 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8371001-7b3e-4cde-9f1c-2119c7e9c7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Flow 'volume_create_manager' (8f457849-8faf-4322-803a-b801766a8460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:14:44 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-0f73baaa-cf0b-4b82-8cd5-685d713ca2bf tempest-VolumesListAdminTestJSON-1795099550 None] Created volume successfully. Sep 25 17:14:45 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:14:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Flow 'volume_create_manager' (03f5c02d-1b24-4e6e-9e8e-04ab3f04653b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:14:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff356817-7816-4956-97e9-5a553e64bc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff356817-7816-4956-97e9-5a553e64bc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ad5f79-32b7-41fa-bf97-beea92c25ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8892be3bcb4454ab45a23104cb0a7c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:45Z,use_quota=True,user_id='a05124c846394bb3a76bd40fb280169d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843a7e7d-37a6-491f-88b2-a865397eca6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843a7e7d-37a6-491f-88b2-a865397eca6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f84a7ec-5d3f-42a7-bf02-1db5d2d882ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f84a7ec-5d3f-42a7-bf02-1db5d2d882ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7ad5f79-32b7-41fa-bf97-beea92c25ad7', 'volume_name': 'volume-f7ad5f79-32b7-41fa-bf97-beea92c25ad7', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0abaff4-864b-4855-8d14-2c1a4966affd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0abaff4-864b-4855-8d14-2c1a4966affd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58bad800-4a7b-44c6-a611-2fd1238f4583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:45 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Volume f7ad5f79-32b7-41fa-bf97-beea92c25ad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7ad5f79-32b7-41fa-bf97-beea92c25ad7', 'volume_size': 1} Sep 25 17:14:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ad5f79-32b7-41fa-bf97-beea92c25ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8892be3bcb4454ab45a23104cb0a7c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:45Z,use_quota=True,user_id='a05124c846394bb3a76bd40fb280169d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:14:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Creating volume f7ad5f79-32b7-41fa-bf97-beea92c25ad7 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:14:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:14:45 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:14:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f7ad5f79-32b7-41fa-bf97-beea92c25ad7 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:45 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f7ad5f79-32b7-41fa-bf97-beea92c25ad7 1073741824 Sep 25 17:14:45 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:46 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f7ad5f79-32b7-41fa-bf97-beea92c25ad7 1073741824" returned: 0 in 0.643s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f7ad5f79-32b7-41fa-bf97-beea92c25ad7 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:46 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f7ad5f79-32b7-41fa-bf97-beea92c25ad7 Sep 25 17:14:46 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:46 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f7ad5f79-32b7-41fa-bf97-beea92c25ad7" returned: 0 in 0.318s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:46 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:14:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58bad800-4a7b-44c6-a611-2fd1238f4583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7ad5f79-32b7-41fa-bf97-beea92c25ad7', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37692a40-b06b-47cd-ac06-38225ac7901c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:46 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Volume volume-f7ad5f79-32b7-41fa-bf97-beea92c25ad7 (f7ad5f79-32b7-41fa-bf97-beea92c25ad7): created successfully Sep 25 17:14:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37692a40-b06b-47cd-ac06-38225ac7901c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Flow 'volume_create_manager' (03f5c02d-1b24-4e6e-9e8e-04ab3f04653b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:14:46 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-c4c25c58-7f25-4d14-826e-b865afa5c501 tempest-VolumesListAdminTestJSON-303652445 None] Created volume successfully. Sep 25 17:14:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a40f59f5-f0af-47be-9281-80bc86dd16b4 tempest-VolumesListAdminTestJSON-303652445 None] Acquiring lock "cinder-f7ad5f79-32b7-41fa-bf97-beea92c25ad7-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:14:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a40f59f5-f0af-47be-9281-80bc86dd16b4 tempest-VolumesListAdminTestJSON-303652445 None] Lock "cinder-f7ad5f79-32b7-41fa-bf97-beea92c25ad7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:14:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a40f59f5-f0af-47be-9281-80bc86dd16b4 tempest-VolumesListAdminTestJSON-303652445 None] Acquiring lock "cinder-quobyte-f7ad5f79-32b7-41fa-bf97-beea92c25ad7" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:14:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a40f59f5-f0af-47be-9281-80bc86dd16b4 tempest-VolumesListAdminTestJSON-303652445 None] Lock "cinder-quobyte-f7ad5f79-32b7-41fa-bf97-beea92c25ad7" acquired by "delete_volume" :: waited 0.032s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:14:47 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4864e82e-e671-4d56-9826-41eb53e152d1]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:14:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a40f59f5-f0af-47be-9281-80bc86dd16b4 tempest-VolumesListAdminTestJSON-303652445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f7ad5f79-32b7-41fa-bf97-beea92c25ad7 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:48 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f108e43f-62ba-4103-b18b-efdde8264f51 tempest-VolumesListAdminTestJSON-1795099550 None] Acquiring lock "cinder-11ba5259-b7a1-466f-82a5-ba2a0daf0957-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:14:48 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f108e43f-62ba-4103-b18b-efdde8264f51 tempest-VolumesListAdminTestJSON-1795099550 None] Lock "cinder-11ba5259-b7a1-466f-82a5-ba2a0daf0957-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:14:48 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f7ad5f79-32b7-41fa-bf97-beea92c25ad7 Sep 25 17:14:48 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:48 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f108e43f-62ba-4103-b18b-efdde8264f51 tempest-VolumesListAdminTestJSON-1795099550 None] Acquiring lock "cinder-quobyte-11ba5259-b7a1-466f-82a5-ba2a0daf0957" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:14:48 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f108e43f-62ba-4103-b18b-efdde8264f51 tempest-VolumesListAdminTestJSON-1795099550 None] Lock "cinder-quobyte-11ba5259-b7a1-466f-82a5-ba2a0daf0957" acquired by "delete_volume" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:14:48 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[c340e86d-b843-41f9-ba9f-6a0432942bfc]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:14:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f108e43f-62ba-4103-b18b-efdde8264f51 tempest-VolumesListAdminTestJSON-1795099550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-11ba5259-b7a1-466f-82a5-ba2a0daf0957 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:48 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-11ba5259-b7a1-466f-82a5-ba2a0daf0957 Sep 25 17:14:48 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:48 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a40f59f5-f0af-47be-9281-80bc86dd16b4 tempest-VolumesListAdminTestJSON-303652445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f7ad5f79-32b7-41fa-bf97-beea92c25ad7" returned: 0 in 0.487s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a40f59f5-f0af-47be-9281-80bc86dd16b4 tempest-VolumesListAdminTestJSON-303652445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f7ad5f79-32b7-41fa-bf97-beea92c25ad7 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:48 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f7ad5f79-32b7-41fa-bf97-beea92c25ad7 Sep 25 17:14:48 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:48 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f108e43f-62ba-4103-b18b-efdde8264f51 tempest-VolumesListAdminTestJSON-1795099550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-11ba5259-b7a1-466f-82a5-ba2a0daf0957" returned: 0 in 0.459s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f108e43f-62ba-4103-b18b-efdde8264f51 tempest-VolumesListAdminTestJSON-1795099550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-11ba5259-b7a1-466f-82a5-ba2a0daf0957 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:48 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-11ba5259-b7a1-466f-82a5-ba2a0daf0957 Sep 25 17:14:48 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:48 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a40f59f5-f0af-47be-9281-80bc86dd16b4 tempest-VolumesListAdminTestJSON-303652445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f7ad5f79-32b7-41fa-bf97-beea92c25ad7" returned: 0 in 0.300s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:48 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a40f59f5-f0af-47be-9281-80bc86dd16b4 tempest-VolumesListAdminTestJSON-303652445 None] Lock "cinder-quobyte-f7ad5f79-32b7-41fa-bf97-beea92c25ad7" released by "delete_volume" :: held 0.849s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:14:48 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-a40f59f5-f0af-47be-9281-80bc86dd16b4 tempest-VolumesListAdminTestJSON-303652445 None] Created reservations ['b15bbcd6-bed7-462e-b547-00cbfe906a5f', 'b91362cf-525f-4300-aa6a-c94f28a07835', '351dbc43-c7e2-4caa-a735-f48b7fad8d5c', '720b3aa4-160e-470a-b580-175d173fc10e'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:14:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a40f59f5-f0af-47be-9281-80bc86dd16b4 tempest-VolumesListAdminTestJSON-303652445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a40f59f5-f0af-47be-9281-80bc86dd16b4 tempest-VolumesListAdminTestJSON-303652445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a40f59f5-f0af-47be-9281-80bc86dd16b4 tempest-VolumesListAdminTestJSON-303652445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a40f59f5-f0af-47be-9281-80bc86dd16b4 tempest-VolumesListAdminTestJSON-303652445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a40f59f5-f0af-47be-9281-80bc86dd16b4 tempest-VolumesListAdminTestJSON-303652445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a40f59f5-f0af-47be-9281-80bc86dd16b4 tempest-VolumesListAdminTestJSON-303652445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:48 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:14:48 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:48 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f108e43f-62ba-4103-b18b-efdde8264f51 tempest-VolumesListAdminTestJSON-1795099550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-11ba5259-b7a1-466f-82a5-ba2a0daf0957" returned: 0 in 0.363s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f108e43f-62ba-4103-b18b-efdde8264f51 tempest-VolumesListAdminTestJSON-1795099550 None] Lock "cinder-quobyte-11ba5259-b7a1-466f-82a5-ba2a0daf0957" released by "delete_volume" :: held 0.886s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:14:49 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-f108e43f-62ba-4103-b18b-efdde8264f51 tempest-VolumesListAdminTestJSON-1795099550 None] Created reservations ['7931effd-f00e-4b0f-a3bf-eedf4fa3fd65', '73077719-72ed-4d9d-819f-0ad17d3c4e3e', 'd7d5ef5e-a566-4924-8c99-a24f437fbc4b', '193f54ac-144f-41a3-bdcb-663da1c9cd97'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:14:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f108e43f-62ba-4103-b18b-efdde8264f51 tempest-VolumesListAdminTestJSON-1795099550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f108e43f-62ba-4103-b18b-efdde8264f51 tempest-VolumesListAdminTestJSON-1795099550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f108e43f-62ba-4103-b18b-efdde8264f51 tempest-VolumesListAdminTestJSON-1795099550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f108e43f-62ba-4103-b18b-efdde8264f51 tempest-VolumesListAdminTestJSON-1795099550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f108e43f-62ba-4103-b18b-efdde8264f51 tempest-VolumesListAdminTestJSON-1795099550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f108e43f-62ba-4103-b18b-efdde8264f51 tempest-VolumesListAdminTestJSON-1795099550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:49 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:14:49 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:49 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a40f59f5-f0af-47be-9281-80bc86dd16b4 tempest-VolumesListAdminTestJSON-303652445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.408s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:49 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-a40f59f5-f0af-47be-9281-80bc86dd16b4 tempest-VolumesListAdminTestJSON-303652445 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:14:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fd5bb1d6-bb7b-483f-b14a-fcfc95a809a1 tempest-VolumesListAdminTestJSON-1795099550 None] Acquiring lock "cinder-13eb08c1-a85f-4a2a-8b39-dc7a62e75079-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:14:49 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-a40f59f5-f0af-47be-9281-80bc86dd16b4 tempest-VolumesListAdminTestJSON-303652445 None] Deleted volume successfully. Sep 25 17:14:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a40f59f5-f0af-47be-9281-80bc86dd16b4 tempest-VolumesListAdminTestJSON-303652445 None] Lock "cinder-f7ad5f79-32b7-41fa-bf97-beea92c25ad7-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:14:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fd5bb1d6-bb7b-483f-b14a-fcfc95a809a1 tempest-VolumesListAdminTestJSON-1795099550 None] Lock "cinder-13eb08c1-a85f-4a2a-8b39-dc7a62e75079-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:14:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fd5bb1d6-bb7b-483f-b14a-fcfc95a809a1 tempest-VolumesListAdminTestJSON-1795099550 None] Acquiring lock "cinder-quobyte-13eb08c1-a85f-4a2a-8b39-dc7a62e75079" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:14:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fd5bb1d6-bb7b-483f-b14a-fcfc95a809a1 tempest-VolumesListAdminTestJSON-1795099550 None] Lock "cinder-quobyte-13eb08c1-a85f-4a2a-8b39-dc7a62e75079" acquired by "delete_volume" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:14:49 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec70c88-9188-4852-b601-2b4c86d82ae0]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:14:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fd5bb1d6-bb7b-483f-b14a-fcfc95a809a1 tempest-VolumesListAdminTestJSON-1795099550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-13eb08c1-a85f-4a2a-8b39-dc7a62e75079 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:49 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f108e43f-62ba-4103-b18b-efdde8264f51 tempest-VolumesListAdminTestJSON-1795099550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.355s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:49 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-f108e43f-62ba-4103-b18b-efdde8264f51 tempest-VolumesListAdminTestJSON-1795099550 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:14:49 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-f108e43f-62ba-4103-b18b-efdde8264f51 tempest-VolumesListAdminTestJSON-1795099550 None] Deleted volume successfully. Sep 25 17:14:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f108e43f-62ba-4103-b18b-efdde8264f51 tempest-VolumesListAdminTestJSON-1795099550 None] Lock "cinder-11ba5259-b7a1-466f-82a5-ba2a0daf0957-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:14:49 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-13eb08c1-a85f-4a2a-8b39-dc7a62e75079 Sep 25 17:14:49 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:49 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fd5bb1d6-bb7b-483f-b14a-fcfc95a809a1 tempest-VolumesListAdminTestJSON-1795099550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-13eb08c1-a85f-4a2a-8b39-dc7a62e75079" returned: 0 in 0.414s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fd5bb1d6-bb7b-483f-b14a-fcfc95a809a1 tempest-VolumesListAdminTestJSON-1795099550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-13eb08c1-a85f-4a2a-8b39-dc7a62e75079 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:49 devstack sudo[99076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-13eb08c1-a85f-4a2a-8b39-dc7a62e75079 Sep 25 17:14:49 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:50 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fd5bb1d6-bb7b-483f-b14a-fcfc95a809a1 tempest-VolumesListAdminTestJSON-1795099550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-13eb08c1-a85f-4a2a-8b39-dc7a62e75079" returned: 0 in 0.325s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fd5bb1d6-bb7b-483f-b14a-fcfc95a809a1 tempest-VolumesListAdminTestJSON-1795099550 None] Lock "cinder-quobyte-13eb08c1-a85f-4a2a-8b39-dc7a62e75079" released by "delete_volume" :: held 0.793s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:14:50 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-fd5bb1d6-bb7b-483f-b14a-fcfc95a809a1 tempest-VolumesListAdminTestJSON-1795099550 None] Created reservations ['6bfd4780-2e7b-475b-867f-d48b58f4533d', '35caab12-80bd-436a-b2e8-4b1619f3c225', 'e16183dc-8895-421d-b50e-62e671d9cab0', '2f26e36f-7039-47ac-874a-b03de6e15f16'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:14:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-fd5bb1d6-bb7b-483f-b14a-fcfc95a809a1 tempest-VolumesListAdminTestJSON-1795099550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-fd5bb1d6-bb7b-483f-b14a-fcfc95a809a1 tempest-VolumesListAdminTestJSON-1795099550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-fd5bb1d6-bb7b-483f-b14a-fcfc95a809a1 tempest-VolumesListAdminTestJSON-1795099550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-fd5bb1d6-bb7b-483f-b14a-fcfc95a809a1 tempest-VolumesListAdminTestJSON-1795099550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-fd5bb1d6-bb7b-483f-b14a-fcfc95a809a1 tempest-VolumesListAdminTestJSON-1795099550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fd5bb1d6-bb7b-483f-b14a-fcfc95a809a1 tempest-VolumesListAdminTestJSON-1795099550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:50 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:14:50 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-198c5913-38d2-47e6-8bd0-cb35cc5aa472 tempest-VolumesListAdminTestJSON-1795099550 None] Acquiring lock "cinder-fd549fbc-afe7-47fa-ae1e-5a0896a1e211-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:14:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-198c5913-38d2-47e6-8bd0-cb35cc5aa472 tempest-VolumesListAdminTestJSON-1795099550 None] Lock "cinder-fd549fbc-afe7-47fa-ae1e-5a0896a1e211-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:14:50 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fd5bb1d6-bb7b-483f-b14a-fcfc95a809a1 tempest-VolumesListAdminTestJSON-1795099550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.285s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:50 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-fd5bb1d6-bb7b-483f-b14a-fcfc95a809a1 tempest-VolumesListAdminTestJSON-1795099550 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:14:50 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-fd5bb1d6-bb7b-483f-b14a-fcfc95a809a1 tempest-VolumesListAdminTestJSON-1795099550 None] Deleted volume successfully. Sep 25 17:14:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-198c5913-38d2-47e6-8bd0-cb35cc5aa472 tempest-VolumesListAdminTestJSON-1795099550 None] Acquiring lock "cinder-quobyte-fd549fbc-afe7-47fa-ae1e-5a0896a1e211" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:14:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fd5bb1d6-bb7b-483f-b14a-fcfc95a809a1 tempest-VolumesListAdminTestJSON-1795099550 None] Lock "cinder-13eb08c1-a85f-4a2a-8b39-dc7a62e75079-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:14:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-198c5913-38d2-47e6-8bd0-cb35cc5aa472 tempest-VolumesListAdminTestJSON-1795099550 None] Lock "cinder-quobyte-fd549fbc-afe7-47fa-ae1e-5a0896a1e211" acquired by "delete_volume" :: waited 0.026s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:14:50 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f189cf-20b1-4879-833c-8199bf1487fb]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:14:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-198c5913-38d2-47e6-8bd0-cb35cc5aa472 tempest-VolumesListAdminTestJSON-1795099550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd549fbc-afe7-47fa-ae1e-5a0896a1e211 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:50 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd549fbc-afe7-47fa-ae1e-5a0896a1e211 Sep 25 17:14:50 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:51 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-198c5913-38d2-47e6-8bd0-cb35cc5aa472 tempest-VolumesListAdminTestJSON-1795099550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd549fbc-afe7-47fa-ae1e-5a0896a1e211" returned: 0 in 0.437s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-198c5913-38d2-47e6-8bd0-cb35cc5aa472 tempest-VolumesListAdminTestJSON-1795099550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd549fbc-afe7-47fa-ae1e-5a0896a1e211 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:51 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd549fbc-afe7-47fa-ae1e-5a0896a1e211 Sep 25 17:14:51 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:51 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-198c5913-38d2-47e6-8bd0-cb35cc5aa472 tempest-VolumesListAdminTestJSON-1795099550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd549fbc-afe7-47fa-ae1e-5a0896a1e211" returned: 0 in 0.257s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-198c5913-38d2-47e6-8bd0-cb35cc5aa472 tempest-VolumesListAdminTestJSON-1795099550 None] Lock "cinder-quobyte-fd549fbc-afe7-47fa-ae1e-5a0896a1e211" released by "delete_volume" :: held 0.749s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:14:51 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-198c5913-38d2-47e6-8bd0-cb35cc5aa472 tempest-VolumesListAdminTestJSON-1795099550 None] Created reservations ['f8486e5e-8278-44f7-83b2-4145a1272da3', '1b970994-3e0d-459c-b5e3-a17a00c189fd', 'bb858899-1bc3-44c3-8943-0e61507b1985', 'bf8c402c-8d95-4067-8064-c34f23c17a0d'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:14:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-198c5913-38d2-47e6-8bd0-cb35cc5aa472 tempest-VolumesListAdminTestJSON-1795099550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-198c5913-38d2-47e6-8bd0-cb35cc5aa472 tempest-VolumesListAdminTestJSON-1795099550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-198c5913-38d2-47e6-8bd0-cb35cc5aa472 tempest-VolumesListAdminTestJSON-1795099550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-198c5913-38d2-47e6-8bd0-cb35cc5aa472 tempest-VolumesListAdminTestJSON-1795099550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-198c5913-38d2-47e6-8bd0-cb35cc5aa472 tempest-VolumesListAdminTestJSON-1795099550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-198c5913-38d2-47e6-8bd0-cb35cc5aa472 tempest-VolumesListAdminTestJSON-1795099550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:51 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:14:51 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:52 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-198c5913-38d2-47e6-8bd0-cb35cc5aa472 tempest-VolumesListAdminTestJSON-1795099550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.403s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:52 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-198c5913-38d2-47e6-8bd0-cb35cc5aa472 tempest-VolumesListAdminTestJSON-1795099550 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:14:52 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-198c5913-38d2-47e6-8bd0-cb35cc5aa472 tempest-VolumesListAdminTestJSON-1795099550 None] Deleted volume successfully. Sep 25 17:14:52 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-198c5913-38d2-47e6-8bd0-cb35cc5aa472 tempest-VolumesListAdminTestJSON-1795099550 None] Lock "cinder-fd549fbc-afe7-47fa-ae1e-5a0896a1e211-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:14:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:14:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:53 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:14:53 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:54 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.374s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:54 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:14:54 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:14:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 28 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:14:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:14:56 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:14:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Flow 'volume_create_manager' (7cdfc4f2-3725-4fc6-baff-0ac19accc3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:14:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca24d68f-9398-4b6c-a047-47431172dbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca24d68f-9398-4b6c-a047-47431172dbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1099814263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf93ed85-ed68-4ef6-b849-d8ca22fe9965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99098d0616604af2835ca5288cf418c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:56Z,use_quota=True,user_id='b9d54ce3b95f45f39f94a396a20bb272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b803ed8-10dd-4ca8-8e5a-3886e0a0c333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b803ed8-10dd-4ca8-8e5a-3886e0a0c333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4455dab2-e761-4c41-8d7f-4d8067d04ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4455dab2-e761-4c41-8d7f-4d8067d04ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf93ed85-ed68-4ef6-b849-d8ca22fe9965', 'volume_name': 'volume-cf93ed85-ed68-4ef6-b849-d8ca22fe9965', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98388bff-e037-4ece-a637-7aee5fbe329b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98388bff-e037-4ece-a637-7aee5fbe329b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27669e7-54d9-46ec-b8a1-fa863695e96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:56 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Volume cf93ed85-ed68-4ef6-b849-d8ca22fe9965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf93ed85-ed68-4ef6-b849-d8ca22fe9965', 'volume_size': 1} Sep 25 17:14:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1099814263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf93ed85-ed68-4ef6-b849-d8ca22fe9965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99098d0616604af2835ca5288cf418c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:56Z,use_quota=True,user_id='b9d54ce3b95f45f39f94a396a20bb272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:14:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Creating volume cf93ed85-ed68-4ef6-b849-d8ca22fe9965 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:14:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:14:56 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:14:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cf93ed85-ed68-4ef6-b849-d8ca22fe9965 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:56 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cf93ed85-ed68-4ef6-b849-d8ca22fe9965 1073741824 Sep 25 17:14:56 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:57 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cf93ed85-ed68-4ef6-b849-d8ca22fe9965 1073741824" returned: 0 in 0.691s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cf93ed85-ed68-4ef6-b849-d8ca22fe9965 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:57 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cf93ed85-ed68-4ef6-b849-d8ca22fe9965 Sep 25 17:14:57 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:57 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cf93ed85-ed68-4ef6-b849-d8ca22fe9965" returned: 0 in 0.355s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:14:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27669e7-54d9-46ec-b8a1-fa863695e96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf93ed85-ed68-4ef6-b849-d8ca22fe9965', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ee09ac-0fe5-4aaa-9b52-71efbc239c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:57 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Volume volume-cf93ed85-ed68-4ef6-b849-d8ca22fe9965 (cf93ed85-ed68-4ef6-b849-d8ca22fe9965): created successfully Sep 25 17:14:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ee09ac-0fe5-4aaa-9b52-71efbc239c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Flow 'volume_create_manager' (7cdfc4f2-3725-4fc6-baff-0ac19accc3cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:14:57 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-789e81e1-58b3-4d80-922b-94ebfc2347ed tempest-AttachVolumeNegativeTest-878525210 None] Created volume successfully. Sep 25 17:14:59 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-a704b7a4-1da3-4d73-bfb7-d2bf6f8a8fd7 req-ea0a5789-9e13-4de4-af84-6145cb6e3968 tempest-TestMinimumBasicScenario-735853333 None] Terminate volume connection completed successfully. Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-a704b7a4-1da3-4d73-bfb7-d2bf6f8a8fd7 req-ea0a5789-9e13-4de4-af84-6145cb6e3968 tempest-TestMinimumBasicScenario-735853333 None] Deleting attachment 792219ee-e27e-410d-985e-9e0b88c598d0. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-cb41b208-d87c-4a22-bbec-2eccdb90a1ce req-fa3216b1-5266-4489-ae35-12bf39a028d1 tempest-AttachVolumeNegativeTest-878525210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-cb41b208-d87c-4a22-bbec-2eccdb90a1ce req-fa3216b1-5266-4489-ae35-12bf39a028d1 tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-cb41b208-d87c-4a22-bbec-2eccdb90a1ce req-fa3216b1-5266-4489-ae35-12bf39a028d1 tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-cb41b208-d87c-4a22-bbec-2eccdb90a1ce req-fa3216b1-5266-4489-ae35-12bf39a028d1 tempest-AttachVolumeNegativeTest-878525210 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-cf93ed85-ed68-4ef6-b849-d8ca22fe9965', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ad57cd0-0709-40ee-8fce-a62297c8fddf', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Flow 'volume_create_manager' (d22950c3-e77f-4eb2-a513-137ac4459427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c1eb93-8d51-41e3-a01f-6bfd21fb20e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c1eb93-8d51-41e3-a01f-6bfd21fb20e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-636400704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd38424-dcf9-4e36-9350-2604176ebf64,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4fbbb4b3355c4a6ca131d035e9961f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:00Z,use_quota=True,user_id='34796e016d4745b68751b71735d2093b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c99dec3-efd3-49f4-94c8-f5a31c13ec4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c99dec3-efd3-49f4-94c8-f5a31c13ec4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf425d0-b973-4f54-8a57-97051479396d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf425d0-b973-4f54-8a57-97051479396d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dd38424-dcf9-4e36-9350-2604176ebf64', 'volume_name': 'volume-0dd38424-dcf9-4e36-9350-2604176ebf64', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9cee6f6-9d2a-4aaf-a13c-d6bd0b7023fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9cee6f6-9d2a-4aaf-a13c-d6bd0b7023fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d2618e-acba-41bd-a318-b1ba5916a780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:59 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Volume 0dd38424-dcf9-4e36-9350-2604176ebf64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dd38424-dcf9-4e36-9350-2604176ebf64', 'volume_size': 1} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-636400704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd38424-dcf9-4e36-9350-2604176ebf64,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4fbbb4b3355c4a6ca131d035e9961f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:00Z,use_quota=True,user_id='34796e016d4745b68751b71735d2093b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Creating volume 0dd38424-dcf9-4e36-9350-2604176ebf64 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:14:59 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:14:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dd38424-dcf9-4e36-9350-2604176ebf64 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:59 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dd38424-dcf9-4e36-9350-2604176ebf64 1073741824 Sep 25 17:14:59 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:59 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-cb41b208-d87c-4a22-bbec-2eccdb90a1ce req-fa3216b1-5266-4489-ae35-12bf39a028d1 tempest-AttachVolumeNegativeTest-878525210 None] attachment_update completed successfully. Sep 25 17:15:00 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dd38424-dcf9-4e36-9350-2604176ebf64 1073741824" returned: 0 in 0.536s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dd38424-dcf9-4e36-9350-2604176ebf64 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:00 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dd38424-dcf9-4e36-9350-2604176ebf64 Sep 25 17:15:00 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8dfe0b2d-3a25-4d61-a182-5cc139f76f7e tempest-TestMinimumBasicScenario-735853333 None] Acquiring lock "cinder-62f0845b-dd80-4bf8-94c0-f55e923bcf7d-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8dfe0b2d-3a25-4d61-a182-5cc139f76f7e tempest-TestMinimumBasicScenario-735853333 None] Lock "cinder-62f0845b-dd80-4bf8-94c0-f55e923bcf7d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:00 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dd38424-dcf9-4e36-9350-2604176ebf64" returned: 0 in 0.334s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:00 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:00 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d2618e-acba-41bd-a318-b1ba5916a780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dd38424-dcf9-4e36-9350-2604176ebf64', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:00 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e638b1-2bc6-4585-be52-37b76eb36624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8dfe0b2d-3a25-4d61-a182-5cc139f76f7e tempest-TestMinimumBasicScenario-735853333 None] Acquiring lock "cinder-quobyte-62f0845b-dd80-4bf8-94c0-f55e923bcf7d" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:00 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Volume volume-0dd38424-dcf9-4e36-9350-2604176ebf64 (0dd38424-dcf9-4e36-9350-2604176ebf64): created successfully Sep 25 17:15:00 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e638b1-2bc6-4585-be52-37b76eb36624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:00 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Flow 'volume_create_manager' (d22950c3-e77f-4eb2-a513-137ac4459427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8dfe0b2d-3a25-4d61-a182-5cc139f76f7e tempest-TestMinimumBasicScenario-735853333 None] Lock "cinder-quobyte-62f0845b-dd80-4bf8-94c0-f55e923bcf7d" acquired by "delete_volume" :: waited 0.039s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:00 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[7623fa2a-b56b-42b1-85dc-6691abde0409]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8dfe0b2d-3a25-4d61-a182-5cc139f76f7e tempest-TestMinimumBasicScenario-735853333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-62f0845b-dd80-4bf8-94c0-f55e923bcf7d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:00 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-f170af5d-1f55-4c2f-83cc-f2151078b9a7 tempest-VolumesGetTest-1429595378 None] Created volume successfully. Sep 25 17:15:01 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-62f0845b-dd80-4bf8-94c0-f55e923bcf7d Sep 25 17:15:01 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:01 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8dfe0b2d-3a25-4d61-a182-5cc139f76f7e tempest-TestMinimumBasicScenario-735853333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-62f0845b-dd80-4bf8-94c0-f55e923bcf7d" returned: 0 in 0.574s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8dfe0b2d-3a25-4d61-a182-5cc139f76f7e tempest-TestMinimumBasicScenario-735853333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-62f0845b-dd80-4bf8-94c0-f55e923bcf7d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:01 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-62f0845b-dd80-4bf8-94c0-f55e923bcf7d Sep 25 17:15:01 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:01 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8dfe0b2d-3a25-4d61-a182-5cc139f76f7e tempest-TestMinimumBasicScenario-735853333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-62f0845b-dd80-4bf8-94c0-f55e923bcf7d" returned: 0 in 0.359s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8dfe0b2d-3a25-4d61-a182-5cc139f76f7e tempest-TestMinimumBasicScenario-735853333 None] Lock "cinder-quobyte-62f0845b-dd80-4bf8-94c0-f55e923bcf7d" released by "delete_volume" :: held 1.001s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:01 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-8dfe0b2d-3a25-4d61-a182-5cc139f76f7e tempest-TestMinimumBasicScenario-735853333 None] Created reservations ['42dd8b7c-716e-4baa-b7ca-a34af8ac88e4', '49769bb9-456b-4747-8d90-b1815a5ff094', 'e6d41d3f-3f8f-46ac-ae90-33eb72090297', 'e4b76d57-03dc-48e8-8626-a6f52c98315d'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8dfe0b2d-3a25-4d61-a182-5cc139f76f7e tempest-TestMinimumBasicScenario-735853333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8dfe0b2d-3a25-4d61-a182-5cc139f76f7e tempest-TestMinimumBasicScenario-735853333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8dfe0b2d-3a25-4d61-a182-5cc139f76f7e tempest-TestMinimumBasicScenario-735853333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8dfe0b2d-3a25-4d61-a182-5cc139f76f7e tempest-TestMinimumBasicScenario-735853333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8dfe0b2d-3a25-4d61-a182-5cc139f76f7e tempest-TestMinimumBasicScenario-735853333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8dfe0b2d-3a25-4d61-a182-5cc139f76f7e tempest-TestMinimumBasicScenario-735853333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:02 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:15:02 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:02 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8dfe0b2d-3a25-4d61-a182-5cc139f76f7e tempest-TestMinimumBasicScenario-735853333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.417s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:02 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-8dfe0b2d-3a25-4d61-a182-5cc139f76f7e tempest-TestMinimumBasicScenario-735853333 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:02 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-8dfe0b2d-3a25-4d61-a182-5cc139f76f7e tempest-TestMinimumBasicScenario-735853333 None] Deleted volume successfully. Sep 25 17:15:02 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8dfe0b2d-3a25-4d61-a182-5cc139f76f7e tempest-TestMinimumBasicScenario-735853333 None] Lock "cinder-62f0845b-dd80-4bf8-94c0-f55e923bcf7d-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:03 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Flow 'volume_create_manager' (e2335712-8b2d-4ddc-be69-1cc112744eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe037c05-ca1b-4869-8a5c-be2ea81969e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe037c05-ca1b-4869-8a5c-be2ea81969e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1713630193',display_name='tempest-VolumesGetTest-Volume-21056418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00550ba9-cfb9-465d-98e9-0b819e17f559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbbb4b3355c4a6ca131d035e9961f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:03Z,use_quota=True,user_id='34796e016d4745b68751b71735d2093b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734c2577-093f-4f80-8807-783a2bb5085d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734c2577-093f-4f80-8807-783a2bb5085d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb12908-d095-48cd-856f-26ad6c21798d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb12908-d095-48cd-856f-26ad6c21798d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00550ba9-cfb9-465d-98e9-0b819e17f559', 'volume_name': 'volume-00550ba9-cfb9-465d-98e9-0b819e17f559', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed80021-e4e4-4f35-b70b-521558538b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed80021-e4e4-4f35-b70b-521558538b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b5f8ab-223e-47c0-b931-777dfe470370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:03 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Volume 00550ba9-cfb9-465d-98e9-0b819e17f559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00550ba9-cfb9-465d-98e9-0b819e17f559', 'volume_size': 1} Sep 25 17:15:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1713630193',display_name='tempest-VolumesGetTest-Volume-21056418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00550ba9-cfb9-465d-98e9-0b819e17f559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbbb4b3355c4a6ca131d035e9961f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:03Z,use_quota=True,user_id='34796e016d4745b68751b71735d2093b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Creating volume 00550ba9-cfb9-465d-98e9-0b819e17f559 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:03 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:15:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-00550ba9-cfb9-465d-98e9-0b819e17f559 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:03 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-00550ba9-cfb9-465d-98e9-0b819e17f559 1073741824 Sep 25 17:15:03 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:04 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-00550ba9-cfb9-465d-98e9-0b819e17f559 1073741824" returned: 0 in 0.706s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-00550ba9-cfb9-465d-98e9-0b819e17f559 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:04 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-00550ba9-cfb9-465d-98e9-0b819e17f559 Sep 25 17:15:04 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:04 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-00550ba9-cfb9-465d-98e9-0b819e17f559" returned: 0 in 0.333s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:04 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b5f8ab-223e-47c0-b931-777dfe470370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00550ba9-cfb9-465d-98e9-0b819e17f559', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78520367-6213-4371-a954-4f729912ea26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:04 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Volume volume-00550ba9-cfb9-465d-98e9-0b819e17f559 (00550ba9-cfb9-465d-98e9-0b819e17f559): created successfully Sep 25 17:15:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78520367-6213-4371-a954-4f729912ea26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Flow 'volume_create_manager' (e2335712-8b2d-4ddc-be69-1cc112744eb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:04 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-912fac4d-0220-49ab-948b-b21d5bc249e8 tempest-VolumesGetTest-1429595378 None] Created volume successfully. Sep 25 17:15:05 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8e7470ae-0029-48a5-ba4a-89709d66132f tempest-VolumesGetTest-1429595378 None] Acquiring lock "cinder-00550ba9-cfb9-465d-98e9-0b819e17f559-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:05 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8e7470ae-0029-48a5-ba4a-89709d66132f tempest-VolumesGetTest-1429595378 None] Lock "cinder-00550ba9-cfb9-465d-98e9-0b819e17f559-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:05 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8e7470ae-0029-48a5-ba4a-89709d66132f tempest-VolumesGetTest-1429595378 None] Acquiring lock "cinder-quobyte-00550ba9-cfb9-465d-98e9-0b819e17f559" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:05 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8e7470ae-0029-48a5-ba4a-89709d66132f tempest-VolumesGetTest-1429595378 None] Lock "cinder-quobyte-00550ba9-cfb9-465d-98e9-0b819e17f559" acquired by "delete_volume" :: waited 0.032s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:05 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e5d59e-9cff-4bc2-8141-5d38d8220ee9]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8e7470ae-0029-48a5-ba4a-89709d66132f tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-00550ba9-cfb9-465d-98e9-0b819e17f559 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:05 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-00550ba9-cfb9-465d-98e9-0b819e17f559 Sep 25 17:15:05 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:06 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8e7470ae-0029-48a5-ba4a-89709d66132f tempest-VolumesGetTest-1429595378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-00550ba9-cfb9-465d-98e9-0b819e17f559" returned: 0 in 0.582s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8e7470ae-0029-48a5-ba4a-89709d66132f tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-00550ba9-cfb9-465d-98e9-0b819e17f559 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:06 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-00550ba9-cfb9-465d-98e9-0b819e17f559 Sep 25 17:15:06 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:06 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8e7470ae-0029-48a5-ba4a-89709d66132f tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-00550ba9-cfb9-465d-98e9-0b819e17f559" returned: 0 in 0.415s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:06 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8e7470ae-0029-48a5-ba4a-89709d66132f tempest-VolumesGetTest-1429595378 None] Lock "cinder-quobyte-00550ba9-cfb9-465d-98e9-0b819e17f559" released by "delete_volume" :: held 1.075s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:06 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-8e7470ae-0029-48a5-ba4a-89709d66132f tempest-VolumesGetTest-1429595378 None] Created reservations ['4a6ef793-1e54-4961-9917-2563c72ae166', '2a304231-ee24-44fd-a7a4-c12729725696', 'f1e95840-bb17-440d-a5b4-011aaea2a69b', '6d5299ec-e029-4009-9ae5-f04797fb1ed4'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8e7470ae-0029-48a5-ba4a-89709d66132f tempest-VolumesGetTest-1429595378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8e7470ae-0029-48a5-ba4a-89709d66132f tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8e7470ae-0029-48a5-ba4a-89709d66132f tempest-VolumesGetTest-1429595378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8e7470ae-0029-48a5-ba4a-89709d66132f tempest-VolumesGetTest-1429595378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8e7470ae-0029-48a5-ba4a-89709d66132f tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8e7470ae-0029-48a5-ba4a-89709d66132f tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:06 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:15:06 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:07 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8e7470ae-0029-48a5-ba4a-89709d66132f tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.384s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:07 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-8e7470ae-0029-48a5-ba4a-89709d66132f tempest-VolumesGetTest-1429595378 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:07 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-8e7470ae-0029-48a5-ba4a-89709d66132f tempest-VolumesGetTest-1429595378 None] Deleted volume successfully. Sep 25 17:15:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8e7470ae-0029-48a5-ba4a-89709d66132f tempest-VolumesGetTest-1429595378 None] Lock "cinder-00550ba9-cfb9-465d-98e9-0b819e17f559-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-22a48d5a-1e71-475c-a495-711abad337e1 tempest-VolumesGetTest-1429595378 None] Acquiring lock "cinder-0dd38424-dcf9-4e36-9350-2604176ebf64-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-22a48d5a-1e71-475c-a495-711abad337e1 tempest-VolumesGetTest-1429595378 None] Lock "cinder-0dd38424-dcf9-4e36-9350-2604176ebf64-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-22a48d5a-1e71-475c-a495-711abad337e1 tempest-VolumesGetTest-1429595378 None] Acquiring lock "cinder-quobyte-0dd38424-dcf9-4e36-9350-2604176ebf64" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-22a48d5a-1e71-475c-a495-711abad337e1 tempest-VolumesGetTest-1429595378 None] Lock "cinder-quobyte-0dd38424-dcf9-4e36-9350-2604176ebf64" acquired by "delete_volume" :: waited 0.030s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:08 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccae4f72-27ed-4f83-bf4f-5686387f9383]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-22a48d5a-1e71-475c-a495-711abad337e1 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dd38424-dcf9-4e36-9350-2604176ebf64 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:08 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dd38424-dcf9-4e36-9350-2604176ebf64 Sep 25 17:15:08 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:08 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-22a48d5a-1e71-475c-a495-711abad337e1 tempest-VolumesGetTest-1429595378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dd38424-dcf9-4e36-9350-2604176ebf64" returned: 0 in 0.474s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-22a48d5a-1e71-475c-a495-711abad337e1 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dd38424-dcf9-4e36-9350-2604176ebf64 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:08 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dd38424-dcf9-4e36-9350-2604176ebf64 Sep 25 17:15:08 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:09 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-22a48d5a-1e71-475c-a495-711abad337e1 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dd38424-dcf9-4e36-9350-2604176ebf64" returned: 0 in 0.394s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:09 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-22a48d5a-1e71-475c-a495-711abad337e1 tempest-VolumesGetTest-1429595378 None] Lock "cinder-quobyte-0dd38424-dcf9-4e36-9350-2604176ebf64" released by "delete_volume" :: held 0.952s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:09 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-22a48d5a-1e71-475c-a495-711abad337e1 tempest-VolumesGetTest-1429595378 None] Created reservations ['e1bc38d1-d064-4f2d-b739-6fa682481e25', '94437e85-9267-4008-9966-3d3d966f2168', '058d4c0d-dc17-4e2f-8c4e-2aeb8fe4e096', 'bb05ff0b-5d9e-425c-b245-6c04505fc475'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-22a48d5a-1e71-475c-a495-711abad337e1 tempest-VolumesGetTest-1429595378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-22a48d5a-1e71-475c-a495-711abad337e1 tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:09 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-22a48d5a-1e71-475c-a495-711abad337e1 tempest-VolumesGetTest-1429595378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:09 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-22a48d5a-1e71-475c-a495-711abad337e1 tempest-VolumesGetTest-1429595378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-22a48d5a-1e71-475c-a495-711abad337e1 tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-22a48d5a-1e71-475c-a495-711abad337e1 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:09 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:15:09 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:09 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-22a48d5a-1e71-475c-a495-711abad337e1 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.459s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:09 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-22a48d5a-1e71-475c-a495-711abad337e1 tempest-VolumesGetTest-1429595378 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:09 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-22a48d5a-1e71-475c-a495-711abad337e1 tempest-VolumesGetTest-1429595378 None] Deleted volume successfully. Sep 25 17:15:09 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-22a48d5a-1e71-475c-a495-711abad337e1 tempest-VolumesGetTest-1429595378 None] Lock "cinder-0dd38424-dcf9-4e36-9350-2604176ebf64-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:11 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Flow 'volume_create_manager' (79ae9638-1178-4cfc-aca8-f0d7d3486c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff6552b-dd1a-4ce2-8c1a-584d8d07227c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff6552b-dd1a-4ce2-8c1a-584d8d07227c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-893982746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb11a2a-3fc3-4984-b32e-738ee4fee848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbbb4b3355c4a6ca131d035e9961f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:11Z,use_quota=True,user_id='34796e016d4745b68751b71735d2093b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67dde76-393f-4b29-a03f-ca187464a11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67dde76-393f-4b29-a03f-ca187464a11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22275c2c-e7c3-485a-b1cb-550f737446fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22275c2c-e7c3-485a-b1cb-550f737446fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cb11a2a-3fc3-4984-b32e-738ee4fee848', 'volume_name': 'volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a47eae4-b146-4920-9f58-11f0add40e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a47eae4-b146-4920-9f58-11f0add40e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9790f119-00c4-40b9-a7e6-de14e2b48e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:11 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Volume 9cb11a2a-3fc3-4984-b32e-738ee4fee848: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848', 'volume_size': 1} Sep 25 17:15:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-893982746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb11a2a-3fc3-4984-b32e-738ee4fee848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbbb4b3355c4a6ca131d035e9961f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:11Z,use_quota=True,user_id='34796e016d4745b68751b71735d2093b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Creating volume 9cb11a2a-3fc3-4984-b32e-738ee4fee848 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:11 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:15:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:11 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 1073741824 Sep 25 17:15:11 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:12 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 1073741824" returned: 0 in 0.762s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:12 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 Sep 25 17:15:12 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:12 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848" returned: 0 in 0.417s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9790f119-00c4-40b9-a7e6-de14e2b48e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1af73fdf-fd16-4d46-a625-eb1ac44b8940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:12 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Volume volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 (9cb11a2a-3fc3-4984-b32e-738ee4fee848): created successfully Sep 25 17:15:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1af73fdf-fd16-4d46-a625-eb1ac44b8940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Flow 'volume_create_manager' (79ae9638-1178-4cfc-aca8-f0d7d3486c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:12 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-d5828e5b-b70d-4ceb-952e-da5795a452a4 tempest-VolumesGetTest-1429595378 None] Created volume successfully. Sep 25 17:15:14 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Flow 'volume_create_manager' (69156b32-7b80-468e-9c5f-ed76bbe3b015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57d6415-edc3-4813-9248-16127cf90eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57d6415-edc3-4813-9248-16127cf90eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1497640019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a23263be-fb8e-414e-ad52-4dadd5b2c903,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4fbbb4b3355c4a6ca131d035e9961f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9cb11a2a-3fc3-4984-b32e-738ee4fee848,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:14Z,use_quota=True,user_id='34796e016d4745b68751b71735d2093b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6033884c-544d-4781-b31a-3bd55ede7afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6033884c-544d-4781-b31a-3bd55ede7afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2810faa1-05de-47f7-a350-795da4af0342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2810faa1-05de-47f7-a350-795da4af0342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a23263be-fb8e-414e-ad52-4dadd5b2c903', 'volume_name': 'volume-a23263be-fb8e-414e-ad52-4dadd5b2c903', 'volume_size': 1, 'source_volid': '9cb11a2a-3fc3-4984-b32e-738ee4fee848', 'source_volstatus': 'available'}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918e0c92-4011-4762-8be3-1158cd1b2aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918e0c92-4011-4762-8be3-1158cd1b2aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2ae5f6-d526-43bf-a28f-308766086f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:14 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Volume a23263be-fb8e-414e-ad52-4dadd5b2c903: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a23263be-fb8e-414e-ad52-4dadd5b2c903', 'volume_size': 1, 'source_volid': '9cb11a2a-3fc3-4984-b32e-738ee4fee848', 'source_volstatus': 'available'} Sep 25 17:15:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:14 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Cloning volume 9cb11a2a-3fc3-4984-b32e-738ee4fee848 to volume a23263be-fb8e-414e-ad52-4dadd5b2c903 Sep 25 17:15:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Creating offline snapshot 594f7ddc-de70-4e12-ae5c-50b6d07ffc4d of volume 9cb11a2a-3fc3-4984-b32e-738ee4fee848 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:15:14 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d895f2eb-3530-430d-8d3e-38d7dfe019ee]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:14 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 Sep 25 17:15:14 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:14 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848" returned: 0 in 0.414s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:14 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d 1G Sep 25 17:15:14 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:15 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d 1G" returned: 0 in 0.604s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:15 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d Sep 25 17:15:15 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:15 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d" returned: 0 in 0.359s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:15 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d is being set with open permissions: ugo+rw Sep 25 17:15:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:15 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d Sep 25 17:15:15 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:16 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d" returned: 0 in 0.331s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:16 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.info Sep 25 17:15:16 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:16 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.info" returned: 0 in 0.318s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:16 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.info is being set with open permissions: ugo+rw Sep 25 17:15:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:16 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.info Sep 25 17:15:16 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:16 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.info" returned: 0 in 0.262s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:16 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Acquiring lock "cinder-quobyte-a23263be-fb8e-414e-ad52-4dadd5b2c903" by "_copy_volume_from_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:16 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Lock "cinder-quobyte-a23263be-fb8e-414e-ad52-4dadd5b2c903" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] snapshot: 594f7ddc-de70-4e12-ae5c-50b6d07ffc4d, volume: a23263be-fb8e-414e-ad52-4dadd5b2c903, {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:15:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:16 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a02939-9e1c-4f33-8129-716e81450926]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:16 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d Sep 25 17:15:16 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:17 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d" returned: 0 in 0.567s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:15:17 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac3c661-3172-42d4-ad0d-e4f4b4b3350a]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:17 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 Sep 25 17:15:17 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:17 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848" returned: 0 in 0.475s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] will copy from snapshot at /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:15:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Creating direct copy from snapshot {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:15:17 devstack cinder-volume[87211]: DEBUG cinder.utils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Path /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a23263be-fb8e-414e-ad52-4dadd5b2c903 not found in is_blk_device check {{(pid=87211) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:15:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a23263be-fb8e-414e-ad52-4dadd5b2c903 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:17 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a23263be-fb8e-414e-ad52-4dadd5b2c903 Sep 25 17:15:17 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:26 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:UPDATE=87,cinder:DELETE=7,cinder:SELECT=70,cinder:INSERT=23 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:15:26 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:UPDATE=78,cinder:SELECT=54,cinder:DELETE=8,cinder:INSERT=15 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:15:26 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a23263be-fb8e-414e-ad52-4dadd5b2c903" returned: 0 in 8.446s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:26 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Image conversion details: src /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848, size 1024.00 MB, duration 8.45 sec, destination /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a23263be-fb8e-414e-ad52-4dadd5b2c903 {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:15:26 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Converted 1024.00 MB image at 121.23 MB/s Sep 25 17:15:26 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a23263be-fb8e-414e-ad52-4dadd5b2c903 is being set with open permissions: ugo+rw Sep 25 17:15:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a23263be-fb8e-414e-ad52-4dadd5b2c903 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:26 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a23263be-fb8e-414e-ad52-4dadd5b2c903 Sep 25 17:15:26 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:26 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a23263be-fb8e-414e-ad52-4dadd5b2c903" returned: 0 in 0.277s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:26 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Lock "cinder-quobyte-a23263be-fb8e-414e-ad52-4dadd5b2c903" released by "_copy_volume_from_snapshot" :: held 9.879s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:26 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Acquiring lock "cinder-quobyte-594f7ddc-de70-4e12-ae5c-50b6d07ffc4d" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:26 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Lock "cinder-quobyte-594f7ddc-de70-4e12-ae5c-50b6d07ffc4d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Deleting offline snapshot 594f7ddc-de70-4e12-ae5c-50b6d07ffc4d of volume 9cb11a2a-3fc3-4984-b32e-738ee4fee848 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:15:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] snapshot_file for this snap is: volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:15:26 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe840500-0351-498f-b630-07640f12fafe]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:26 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d Sep 25 17:15:26 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:27 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d" returned: 0 in 0.435s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:15:27 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff321a7-e98b-4c3e-97f1-d691aa112787]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:27 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 Sep 25 17:15:27 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:27 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848" returned: 0 in 0.789s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:27 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d Sep 25 17:15:27 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:28 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d" returned: 0 in 0.446s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:28 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d Sep 25 17:15:28 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:28 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848.594f7ddc-de70-4e12-ae5c-50b6d07ffc4d" returned: 0 in 0.345s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Lock "cinder-quobyte-594f7ddc-de70-4e12-ae5c-50b6d07ffc4d" released by "_delete_snapshot" :: held 2.144s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.583s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2ae5f6-d526-43bf-a28f-308766086f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a23263be-fb8e-414e-ad52-4dadd5b2c903', 'volume_size': 1, 'source_volid': '9cb11a2a-3fc3-4984-b32e-738ee4fee848', 'source_volstatus': 'available'}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc2b905-a95d-413a-b752-bfd9ef019d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:28 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Volume volume-a23263be-fb8e-414e-ad52-4dadd5b2c903 (a23263be-fb8e-414e-ad52-4dadd5b2c903): created successfully Sep 25 17:15:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc2b905-a95d-413a-b752-bfd9ef019d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Flow 'volume_create_manager' (69156b32-7b80-468e-9c5f-ed76bbe3b015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:28 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-a34cdea6-b8e3-448b-9d92-2f17f5260395 tempest-VolumesGetTest-1429595378 None] Created volume successfully. Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Flow 'volume_create_manager' (e3ca42c9-99be-4f40-89ef-28b0ed24c3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44723fac-6ebf-43fb-8c30-ee7f28ae8dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44723fac-6ebf-43fb-8c30-ee7f28ae8dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1889959728',display_name='tempest-VolumesGetTest-Volume-1812338447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f098aa08-49da-4fd5-bafe-64587faf3d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbbb4b3355c4a6ca131d035e9961f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:31Z,use_quota=True,user_id='34796e016d4745b68751b71735d2093b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95b188c-ccfb-4838-83d9-8f56ccff92b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95b188c-ccfb-4838-83d9-8f56ccff92b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e491917-06f1-45bf-9737-fa2f094aae43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e491917-06f1-45bf-9737-fa2f094aae43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f098aa08-49da-4fd5-bafe-64587faf3d62', 'volume_name': 'volume-f098aa08-49da-4fd5-bafe-64587faf3d62', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8cfc673-db1b-4387-b8b7-9330f7958b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8cfc673-db1b-4387-b8b7-9330f7958b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad342042-3c43-405d-a41d-f73905284d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:31 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Volume f098aa08-49da-4fd5-bafe-64587faf3d62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f098aa08-49da-4fd5-bafe-64587faf3d62', 'volume_size': 1} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1889959728',display_name='tempest-VolumesGetTest-Volume-1812338447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f098aa08-49da-4fd5-bafe-64587faf3d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbbb4b3355c4a6ca131d035e9961f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:31Z,use_quota=True,user_id='34796e016d4745b68751b71735d2093b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Creating volume f098aa08-49da-4fd5-bafe-64587faf3d62 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:31 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f098aa08-49da-4fd5-bafe-64587faf3d62 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:31 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f098aa08-49da-4fd5-bafe-64587faf3d62 1073741824 Sep 25 17:15:31 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Flow 'volume_create_manager' (5303398c-7d50-4040-a49b-411152418a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bddaa1-9752-44da-a830-e169d9205078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bddaa1-9752-44da-a830-e169d9205078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-538834267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e18832f-0932-46da-bc42-b9f151190be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3cb1e400af34809a2da9541376d3957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:32Z,use_quota=True,user_id='f05881b1f60844de85f7649686b770e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9f2200-8f55-4353-8fba-4171e71b0c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9f2200-8f55-4353-8fba-4171e71b0c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abbb6d10-71f0-476a-a399-a7f8ea663430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abbb6d10-71f0-476a-a399-a7f8ea663430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e18832f-0932-46da-bc42-b9f151190be1', 'volume_name': 'volume-4e18832f-0932-46da-bc42-b9f151190be1', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55078618-efda-469d-aa06-811a12bdcb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55078618-efda-469d-aa06-811a12bdcb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5634202-5d1b-4e1d-9fcc-5a99bc795472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:31 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Volume 4e18832f-0932-46da-bc42-b9f151190be1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e18832f-0932-46da-bc42-b9f151190be1', 'volume_size': 1} Sep 25 17:15:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:32 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Flow 'volume_create_manager' (cb5955b3-f765-4edc-96f8-9a8fde8d5097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ba39d1-c328-4e84-8216-64f36d538fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ba39d1-c328-4e84-8216-64f36d538fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1734296221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a06bf078-4578-404f-93a8-ac4337f8ea21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3cb1e400af34809a2da9541376d3957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:32Z,use_quota=True,user_id='f05881b1f60844de85f7649686b770e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab4f0a8-7e27-451d-9573-ccf60e824a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab4f0a8-7e27-451d-9573-ccf60e824a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e8ad39a-e886-4746-9692-1ba25e204f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e8ad39a-e886-4746-9692-1ba25e204f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a06bf078-4578-404f-93a8-ac4337f8ea21', 'volume_name': 'volume-a06bf078-4578-404f-93a8-ac4337f8ea21', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35462bbe-7449-4217-ba88-c14e3d8b6412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35462bbe-7449-4217-ba88-c14e3d8b6412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c94840a-305f-42f4-9e37-e387ddc0cc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:32 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Volume a06bf078-4578-404f-93a8-ac4337f8ea21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a06bf078-4578-404f-93a8-ac4337f8ea21', 'volume_size': 1} Sep 25 17:15:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:32 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f098aa08-49da-4fd5-bafe-64587faf3d62 1073741824" returned: 0 in 1.169s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f098aa08-49da-4fd5-bafe-64587faf3d62 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:32 devstack sudo[99834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f098aa08-49da-4fd5-bafe-64587faf3d62 Sep 25 17:15:32 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:33 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f098aa08-49da-4fd5-bafe-64587faf3d62" returned: 0 in 0.418s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.081s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-538834267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e18832f-0932-46da-bc42-b9f151190be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3cb1e400af34809a2da9541376d3957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:32Z,use_quota=True,user_id='f05881b1f60844de85f7649686b770e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Creating volume 4e18832f-0932-46da-bc42-b9f151190be1 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:33 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:15:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4e18832f-0932-46da-bc42-b9f151190be1 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad342042-3c43-405d-a41d-f73905284d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f098aa08-49da-4fd5-bafe-64587faf3d62', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a3543a-de97-4fa9-a26c-9ba9076db121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:33 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4e18832f-0932-46da-bc42-b9f151190be1 1073741824 Sep 25 17:15:33 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:33 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Volume volume-f098aa08-49da-4fd5-bafe-64587faf3d62 (f098aa08-49da-4fd5-bafe-64587faf3d62): created successfully Sep 25 17:15:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a3543a-de97-4fa9-a26c-9ba9076db121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Flow 'volume_create_manager' (e3ca42c9-99be-4f40-89ef-28b0ed24c3ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:33 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-04874b82-b0ad-4932-bdec-c51a13d97728 tempest-VolumesGetTest-1429595378 None] Created volume successfully. Sep 25 17:15:33 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4e18832f-0932-46da-bc42-b9f151190be1 1073741824" returned: 0 in 0.766s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4e18832f-0932-46da-bc42-b9f151190be1 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:33 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4e18832f-0932-46da-bc42-b9f151190be1 Sep 25 17:15:33 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:34 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4e18832f-0932-46da-bc42-b9f151190be1" returned: 0 in 0.774s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.494s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1734296221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a06bf078-4578-404f-93a8-ac4337f8ea21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3cb1e400af34809a2da9541376d3957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:32Z,use_quota=True,user_id='f05881b1f60844de85f7649686b770e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Creating volume a06bf078-4578-404f-93a8-ac4337f8ea21 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:34 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:15:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a06bf078-4578-404f-93a8-ac4337f8ea21 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:34 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5634202-5d1b-4e1d-9fcc-5a99bc795472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e18832f-0932-46da-bc42-b9f151190be1', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:34 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a06bf078-4578-404f-93a8-ac4337f8ea21 1073741824 Sep 25 17:15:34 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:34 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ccb33e-0de0-4916-8f9d-3336bfc3944d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-97105aa1-03a0-4ee9-a0cf-c027cd50c737 tempest-VolumesGetTest-1429595378 None] Acquiring lock "cinder-f098aa08-49da-4fd5-bafe-64587faf3d62-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:34 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Volume volume-4e18832f-0932-46da-bc42-b9f151190be1 (4e18832f-0932-46da-bc42-b9f151190be1): created successfully Sep 25 17:15:34 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ccb33e-0de0-4916-8f9d-3336bfc3944d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Flow 'volume_create_manager' (5303398c-7d50-4040-a49b-411152418a3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:35 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-1a9ba574-9bb2-4608-94ee-15cd663f35a9 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Created volume successfully. Sep 25 17:15:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-97105aa1-03a0-4ee9-a0cf-c027cd50c737 tempest-VolumesGetTest-1429595378 None] Lock "cinder-f098aa08-49da-4fd5-bafe-64587faf3d62-delete_volume" acquired by "delete_volume" :: waited 0.236s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-97105aa1-03a0-4ee9-a0cf-c027cd50c737 tempest-VolumesGetTest-1429595378 None] Acquiring lock "cinder-quobyte-f098aa08-49da-4fd5-bafe-64587faf3d62" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-97105aa1-03a0-4ee9-a0cf-c027cd50c737 tempest-VolumesGetTest-1429595378 None] Lock "cinder-quobyte-f098aa08-49da-4fd5-bafe-64587faf3d62" acquired by "delete_volume" :: waited 0.062s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:35 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02e0041-2fad-47d6-bd09-85f090809852]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-97105aa1-03a0-4ee9-a0cf-c027cd50c737 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f098aa08-49da-4fd5-bafe-64587faf3d62 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:35 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f098aa08-49da-4fd5-bafe-64587faf3d62 Sep 25 17:15:35 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:35 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a06bf078-4578-404f-93a8-ac4337f8ea21 1073741824" returned: 0 in 1.058s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a06bf078-4578-404f-93a8-ac4337f8ea21 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:35 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a06bf078-4578-404f-93a8-ac4337f8ea21 Sep 25 17:15:35 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:36 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-97105aa1-03a0-4ee9-a0cf-c027cd50c737 tempest-VolumesGetTest-1429595378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f098aa08-49da-4fd5-bafe-64587faf3d62" returned: 0 in 0.573s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-97105aa1-03a0-4ee9-a0cf-c027cd50c737 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f098aa08-49da-4fd5-bafe-64587faf3d62 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:36 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f098aa08-49da-4fd5-bafe-64587faf3d62 Sep 25 17:15:36 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:36 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-97105aa1-03a0-4ee9-a0cf-c027cd50c737 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f098aa08-49da-4fd5-bafe-64587faf3d62" returned: 0 in 0.489s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:36 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-97105aa1-03a0-4ee9-a0cf-c027cd50c737 tempest-VolumesGetTest-1429595378 None] Lock "cinder-quobyte-f098aa08-49da-4fd5-bafe-64587faf3d62" released by "delete_volume" :: held 1.155s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a06bf078-4578-404f-93a8-ac4337f8ea21" returned: 0 in 0.650s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c94840a-305f-42f4-9e37-e387ddc0cc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a06bf078-4578-404f-93a8-ac4337f8ea21', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeecb7f0-512b-4d3b-bb83-84fcce80af58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:36 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Volume volume-a06bf078-4578-404f-93a8-ac4337f8ea21 (a06bf078-4578-404f-93a8-ac4337f8ea21): created successfully Sep 25 17:15:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeecb7f0-512b-4d3b-bb83-84fcce80af58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Flow 'volume_create_manager' (cb5955b3-f765-4edc-96f8-9a8fde8d5097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:36 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-22ff5782-240c-4f2b-b520-caa4c80e535e tempest-TestServerVolumeAttachmentScenario-2115173390 None] Created volume successfully. Sep 25 17:15:36 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-97105aa1-03a0-4ee9-a0cf-c027cd50c737 tempest-VolumesGetTest-1429595378 None] Created reservations ['1226a8c4-f9c0-4dc8-8bd6-f7754c74dab8', 'b69cf332-e795-448e-8798-854edff63dc9', '9318cc1a-f335-4bb3-a5d1-e0824e0e54c0', '9a8c9267-9a3f-4644-96f1-5fa41126f24f'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-97105aa1-03a0-4ee9-a0cf-c027cd50c737 tempest-VolumesGetTest-1429595378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-97105aa1-03a0-4ee9-a0cf-c027cd50c737 tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-97105aa1-03a0-4ee9-a0cf-c027cd50c737 tempest-VolumesGetTest-1429595378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-97105aa1-03a0-4ee9-a0cf-c027cd50c737 tempest-VolumesGetTest-1429595378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-97105aa1-03a0-4ee9-a0cf-c027cd50c737 tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-97105aa1-03a0-4ee9-a0cf-c027cd50c737 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:36 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:15:36 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:37 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-97105aa1-03a0-4ee9-a0cf-c027cd50c737 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.331s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:37 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-97105aa1-03a0-4ee9-a0cf-c027cd50c737 tempest-VolumesGetTest-1429595378 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:37 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-97105aa1-03a0-4ee9-a0cf-c027cd50c737 tempest-VolumesGetTest-1429595378 None] Deleted volume successfully. Sep 25 17:15:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-97105aa1-03a0-4ee9-a0cf-c027cd50c737 tempest-VolumesGetTest-1429595378 None] Lock "cinder-f098aa08-49da-4fd5-bafe-64587faf3d62-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9611c674-6f3d-4b00-92b1-2ccd7ca625a9 tempest-VolumesGetTest-1429595378 None] Acquiring lock "cinder-a23263be-fb8e-414e-ad52-4dadd5b2c903-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9611c674-6f3d-4b00-92b1-2ccd7ca625a9 tempest-VolumesGetTest-1429595378 None] Lock "cinder-a23263be-fb8e-414e-ad52-4dadd5b2c903-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9611c674-6f3d-4b00-92b1-2ccd7ca625a9 tempest-VolumesGetTest-1429595378 None] Acquiring lock "cinder-quobyte-a23263be-fb8e-414e-ad52-4dadd5b2c903" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9611c674-6f3d-4b00-92b1-2ccd7ca625a9 tempest-VolumesGetTest-1429595378 None] Lock "cinder-quobyte-a23263be-fb8e-414e-ad52-4dadd5b2c903" acquired by "delete_volume" :: waited 0.022s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:37 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1a3fab-e673-492d-8436-cce5d0b141e6]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9611c674-6f3d-4b00-92b1-2ccd7ca625a9 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a23263be-fb8e-414e-ad52-4dadd5b2c903 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:37 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a23263be-fb8e-414e-ad52-4dadd5b2c903 Sep 25 17:15:37 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:38 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9611c674-6f3d-4b00-92b1-2ccd7ca625a9 tempest-VolumesGetTest-1429595378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a23263be-fb8e-414e-ad52-4dadd5b2c903" returned: 0 in 0.501s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9611c674-6f3d-4b00-92b1-2ccd7ca625a9 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a23263be-fb8e-414e-ad52-4dadd5b2c903 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:38 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a23263be-fb8e-414e-ad52-4dadd5b2c903 Sep 25 17:15:38 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:38 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9611c674-6f3d-4b00-92b1-2ccd7ca625a9 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a23263be-fb8e-414e-ad52-4dadd5b2c903" returned: 0 in 0.430s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9611c674-6f3d-4b00-92b1-2ccd7ca625a9 tempest-VolumesGetTest-1429595378 None] Lock "cinder-quobyte-a23263be-fb8e-414e-ad52-4dadd5b2c903" released by "delete_volume" :: held 0.985s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:38 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-9611c674-6f3d-4b00-92b1-2ccd7ca625a9 tempest-VolumesGetTest-1429595378 None] Created reservations ['86d0a005-258c-44ae-a621-221ced3d5a8f', '7ce7054e-fc7d-40cc-91f0-d6c63398200f', 'ff27dd9d-4c1a-4977-99ce-7a8e289479f6', 'c28136ee-4dab-40f9-ab6f-282d93e11f2d'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9611c674-6f3d-4b00-92b1-2ccd7ca625a9 tempest-VolumesGetTest-1429595378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9611c674-6f3d-4b00-92b1-2ccd7ca625a9 tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9611c674-6f3d-4b00-92b1-2ccd7ca625a9 tempest-VolumesGetTest-1429595378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9611c674-6f3d-4b00-92b1-2ccd7ca625a9 tempest-VolumesGetTest-1429595378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9611c674-6f3d-4b00-92b1-2ccd7ca625a9 tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9611c674-6f3d-4b00-92b1-2ccd7ca625a9 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:38 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:15:38 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-008b42fe-5a3b-4843-b520-776930241905 tempest-VolumesGetTest-1429595378 None] Acquiring lock "cinder-9cb11a2a-3fc3-4984-b32e-738ee4fee848-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-008b42fe-5a3b-4843-b520-776930241905 tempest-VolumesGetTest-1429595378 None] Lock "cinder-9cb11a2a-3fc3-4984-b32e-738ee4fee848-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-008b42fe-5a3b-4843-b520-776930241905 tempest-VolumesGetTest-1429595378 None] Acquiring lock "cinder-quobyte-9cb11a2a-3fc3-4984-b32e-738ee4fee848" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-008b42fe-5a3b-4843-b520-776930241905 tempest-VolumesGetTest-1429595378 None] Lock "cinder-quobyte-9cb11a2a-3fc3-4984-b32e-738ee4fee848" acquired by "delete_volume" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:39 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dd63a2-235a-40a5-98f4-4f6db6e834a1]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-008b42fe-5a3b-4843-b520-776930241905 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:39 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9611c674-6f3d-4b00-92b1-2ccd7ca625a9 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.507s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:39 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9611c674-6f3d-4b00-92b1-2ccd7ca625a9 tempest-VolumesGetTest-1429595378 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:39 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-9611c674-6f3d-4b00-92b1-2ccd7ca625a9 tempest-VolumesGetTest-1429595378 None] Deleted volume successfully. Sep 25 17:15:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9611c674-6f3d-4b00-92b1-2ccd7ca625a9 tempest-VolumesGetTest-1429595378 None] Lock "cinder-a23263be-fb8e-414e-ad52-4dadd5b2c903-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:39 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 Sep 25 17:15:39 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:39 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-008b42fe-5a3b-4843-b520-776930241905 tempest-VolumesGetTest-1429595378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848" returned: 0 in 0.582s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-008b42fe-5a3b-4843-b520-776930241905 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:39 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848 Sep 25 17:15:39 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:40 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-008b42fe-5a3b-4843-b520-776930241905 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9cb11a2a-3fc3-4984-b32e-738ee4fee848" returned: 0 in 0.462s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-008b42fe-5a3b-4843-b520-776930241905 tempest-VolumesGetTest-1429595378 None] Lock "cinder-quobyte-9cb11a2a-3fc3-4984-b32e-738ee4fee848" released by "delete_volume" :: held 1.144s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:40 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-008b42fe-5a3b-4843-b520-776930241905 tempest-VolumesGetTest-1429595378 None] Created reservations ['7b6ffd12-2ce5-4d88-a0a0-814ffb43b7e5', '24d4f90f-eb1e-4ce7-8764-0c6aa3f44e7d', '11cebc92-36e0-4681-960b-64702b8fa621', '3734d162-4914-48e7-a726-9e71c8dce4b4'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-008b42fe-5a3b-4843-b520-776930241905 tempest-VolumesGetTest-1429595378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-008b42fe-5a3b-4843-b520-776930241905 tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-008b42fe-5a3b-4843-b520-776930241905 tempest-VolumesGetTest-1429595378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-008b42fe-5a3b-4843-b520-776930241905 tempest-VolumesGetTest-1429595378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-008b42fe-5a3b-4843-b520-776930241905 tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-008b42fe-5a3b-4843-b520-776930241905 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:40 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:15:40 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:40 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-008b42fe-5a3b-4843-b520-776930241905 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.370s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:40 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-008b42fe-5a3b-4843-b520-776930241905 tempest-VolumesGetTest-1429595378 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:40 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-008b42fe-5a3b-4843-b520-776930241905 tempest-VolumesGetTest-1429595378 None] Deleted volume successfully. Sep 25 17:15:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-008b42fe-5a3b-4843-b520-776930241905 tempest-VolumesGetTest-1429595378 None] Lock "cinder-9cb11a2a-3fc3-4984-b32e-738ee4fee848-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:42 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Flow 'volume_create_manager' (f6f915ab-ec51-4f89-b82c-3e6ec0e568a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bce0ca3-3aad-4b96-9fdd-9b20d077a4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bce0ca3-3aad-4b96-9fdd-9b20d077a4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1116700371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b28afe67-af1a-481f-9d04-7972ba6da58e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4fbbb4b3355c4a6ca131d035e9961f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:43Z,use_quota=True,user_id='34796e016d4745b68751b71735d2093b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564dcd43-484c-4916-b57d-649cd7d9a5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564dcd43-484c-4916-b57d-649cd7d9a5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (541264cc-b84c-4aae-b517-9146f24819d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:42 devstack cinder-volume[87211]: DEBUG cinder.image.glance [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Creating Keystone auth plugin from conf {{(pid=87211) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 17:15:43 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (541264cc-b84c-4aae-b517-9146f24819d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b28afe67-af1a-481f-9d04-7972ba6da58e', 'volume_name': 'volume-b28afe67-af1a-481f-9d04-7972ba6da58e', 'volume_size': 1, 'image_id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'acaf9a5e9cfc4af3b32eda10c91e30fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'created_at': datetime.datetime(2026, 9, 25, 14, 58, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:43 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7abee57-56f8-48ab-a618-53a6a24cd02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:43 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7abee57-56f8-48ab-a618-53a6a24cd02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:43 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b729f8-c1bb-442c-bd18-72f2ea46fc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:43 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Volume b28afe67-af1a-481f-9d04-7972ba6da58e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b28afe67-af1a-481f-9d04-7972ba6da58e', 'volume_size': 1, 'image_id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'acaf9a5e9cfc4af3b32eda10c91e30fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'created_at': datetime.datetime(2026, 9, 25, 14, 58, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 17:15:43 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Trying to clone b28afe67-af1a-481f-9d04-7972ba6da58e from image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}]). {{(pid=87211) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 17:15:44 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_unbukx3edevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 17:15:44 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Image download 20.69 MB at 20.69 MB/s Sep 25 17:15:44 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e925b2f-8339-4f16-8c2d-a5097dfcdf82]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_unbukx3edevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:44 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_unbukx3edevstack@QuobyteHD Sep 25 17:15:44 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:44 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_unbukx3edevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:44 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Temporary image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 is fetched for user 34796e016d4745b68751b71735d2093b. {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 17:15:44 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc392d3-0491-4ad9-a509-d294e6728e76]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_unbukx3edevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:44 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_unbukx3edevstack@QuobyteHD Sep 25 17:15:44 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:45 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_unbukx3edevstack@QuobyteHD" returned: 0 in 0.538s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1116700371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b28afe67-af1a-481f-9d04-7972ba6da58e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4fbbb4b3355c4a6ca131d035e9961f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:43Z,use_quota=True,user_id='34796e016d4745b68751b71735d2093b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Creating volume b28afe67-af1a-481f-9d04-7972ba6da58e {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:45 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:15:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b28afe67-af1a-481f-9d04-7972ba6da58e 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:45 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b28afe67-af1a-481f-9d04-7972ba6da58e 1073741824 Sep 25 17:15:45 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:45 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b28afe67-af1a-481f-9d04-7972ba6da58e 1073741824" returned: 0 in 0.722s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b28afe67-af1a-481f-9d04-7972ba6da58e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:46 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b28afe67-af1a-481f-9d04-7972ba6da58e Sep 25 17:15:46 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:46 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b28afe67-af1a-481f-9d04-7972ba6da58e" returned: 0 in 0.649s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:46 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:46 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Attempting download of 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}])) to volume b28afe67-af1a-481f-9d04-7972ba6da58e. {{(pid=87211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 17:15:46 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51c8d22-bc2b-431c-adc0-701bdd7ede1b]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_fldcl43m {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:47 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_fldcl43m Sep 25 17:15:47 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:47 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_fldcl43m" returned: 0 in 0.610s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_fldcl43m {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:47 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_fldcl43m Sep 25 17:15:47 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:47 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_fldcl43m" returned: 1 in 0.406s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_fldcl43m' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:15:47 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f86574-46f6-4d61-8ba6-b9609f8e3276]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_unbukx3edevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:48 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_unbukx3edevstack@QuobyteHD Sep 25 17:15:48 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:48 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_unbukx3edevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:48 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 was qcow2, converting to qcow2 {{(pid=87211) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 17:15:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_unbukx3edevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b28afe67-af1a-481f-9d04-7972ba6da58e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:48 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_unbukx3edevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b28afe67-af1a-481f-9d04-7972ba6da58e Sep 25 17:15:48 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:51 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_unbukx3edevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b28afe67-af1a-481f-9d04-7972ba6da58e" returned: 0 in 3.255s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:51 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_unbukx3edevstack@QuobyteHD, size 112.00 MB, duration 3.26 sec, destination /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b28afe67-af1a-481f-9d04-7972ba6da58e {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:15:51 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Converted 112.00 MB image at 34.39 MB/s Sep 25 17:15:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b28afe67-af1a-481f-9d04-7972ba6da58e 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:51 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b28afe67-af1a-481f-9d04-7972ba6da58e 1G Sep 25 17:15:51 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:52 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b28afe67-af1a-481f-9d04-7972ba6da58e 1G" returned: 0 in 0.785s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:52 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Downloaded image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}])) to volume b28afe67-af1a-481f-9d04-7972ba6da58e successfully. {{(pid=87211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 17:15:52 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Temporary image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 for user 34796e016d4745b68751b71735d2093b is deleted. {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 17:15:52 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Marking volume b28afe67-af1a-481f-9d04-7972ba6da58e as bootable. {{(pid=87211) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 17:15:52 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Copying metadata from image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 to b28afe67-af1a-481f-9d04-7972ba6da58e. {{(pid=87211) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 17:15:52 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Creating volume glance metadata for volume b28afe67-af1a-481f-9d04-7972ba6da58e backed by image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87211) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 17:15:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b729f8-c1bb-442c-bd18-72f2ea46fc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b28afe67-af1a-481f-9d04-7972ba6da58e', 'volume_size': 1, 'image_id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'acaf9a5e9cfc4af3b32eda10c91e30fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'created_at': datetime.datetime(2026, 9, 25, 14, 58, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a92152f6-fb86-445d-b1c9-5fec23c44edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:52 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Volume volume-b28afe67-af1a-481f-9d04-7972ba6da58e (b28afe67-af1a-481f-9d04-7972ba6da58e): created successfully Sep 25 17:15:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a92152f6-fb86-445d-b1c9-5fec23c44edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Flow 'volume_create_manager' (f6f915ab-ec51-4f89-b82c-3e6ec0e568a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:52 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-61bb49aa-f7e3-4cd1-a43f-c67c41f03c48 tempest-VolumesGetTest-1429595378 None] Created volume successfully. Sep 25 17:15:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:15:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:53 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:15:53 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:53 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Flow 'volume_create_manager' (bf0a743b-428d-41d3-9592-ac4ff25f6d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9211dd1c-b963-4359-9d66-52ce7c8e285b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9211dd1c-b963-4359-9d66-52ce7c8e285b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1897286259',display_name='tempest-VolumesGetTest-Volume-2116044608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26cfc36-f3d7-414c-ad2a-99baf076125c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbbb4b3355c4a6ca131d035e9961f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:54Z,use_quota=True,user_id='34796e016d4745b68751b71735d2093b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:54 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86246a63-8ff9-44f8-b6e3-56fd5e1f68a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86246a63-8ff9-44f8-b6e3-56fd5e1f68a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738048f1-df6e-4430-9cc5-e43598d6095c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738048f1-df6e-4430-9cc5-e43598d6095c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e26cfc36-f3d7-414c-ad2a-99baf076125c', 'volume_name': 'volume-e26cfc36-f3d7-414c-ad2a-99baf076125c', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7ee7ca-1f9f-4c36-9c5f-9c4d9c2d2fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7ee7ca-1f9f-4c36-9c5f-9c4d9c2d2fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76dbcc03-2f6c-4764-815b-ae75d2aff681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:54 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Volume e26cfc36-f3d7-414c-ad2a-99baf076125c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e26cfc36-f3d7-414c-ad2a-99baf076125c', 'volume_size': 1} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1897286259',display_name='tempest-VolumesGetTest-Volume-2116044608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26cfc36-f3d7-414c-ad2a-99baf076125c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbbb4b3355c4a6ca131d035e9961f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:54Z,use_quota=True,user_id='34796e016d4745b68751b71735d2093b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Creating volume e26cfc36-f3d7-414c-ad2a-99baf076125c {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:54 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e26cfc36-f3d7-414c-ad2a-99baf076125c 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.491s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 28 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:15:54 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e26cfc36-f3d7-414c-ad2a-99baf076125c 1073741824 Sep 25 17:15:54 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:54 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e26cfc36-f3d7-414c-ad2a-99baf076125c 1073741824" returned: 0 in 0.568s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e26cfc36-f3d7-414c-ad2a-99baf076125c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:54 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e26cfc36-f3d7-414c-ad2a-99baf076125c Sep 25 17:15:54 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:55 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e26cfc36-f3d7-414c-ad2a-99baf076125c" returned: 0 in 0.309s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:55 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76dbcc03-2f6c-4764-815b-ae75d2aff681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e26cfc36-f3d7-414c-ad2a-99baf076125c', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:55 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a899347-ae3a-4415-a898-dd92c71e56bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:55 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Volume volume-e26cfc36-f3d7-414c-ad2a-99baf076125c (e26cfc36-f3d7-414c-ad2a-99baf076125c): created successfully Sep 25 17:15:55 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a899347-ae3a-4415-a898-dd92c71e56bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:55 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Flow 'volume_create_manager' (bf0a743b-428d-41d3-9592-ac4ff25f6d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:55 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-7fbf5fd2-f729-426b-8d7a-f8792a9792fd tempest-VolumesGetTest-1429595378 None] Created volume successfully. Sep 25 17:15:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-676d4df0-1451-4221-b331-e109733ab471 tempest-VolumesGetTest-1429595378 None] Acquiring lock "cinder-e26cfc36-f3d7-414c-ad2a-99baf076125c-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-676d4df0-1451-4221-b331-e109733ab471 tempest-VolumesGetTest-1429595378 None] Lock "cinder-e26cfc36-f3d7-414c-ad2a-99baf076125c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-676d4df0-1451-4221-b331-e109733ab471 tempest-VolumesGetTest-1429595378 None] Acquiring lock "cinder-quobyte-e26cfc36-f3d7-414c-ad2a-99baf076125c" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-676d4df0-1451-4221-b331-e109733ab471 tempest-VolumesGetTest-1429595378 None] Lock "cinder-quobyte-e26cfc36-f3d7-414c-ad2a-99baf076125c" acquired by "delete_volume" :: waited 0.022s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:56 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf6bf19-0c88-4ddc-8752-536927afa949]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-676d4df0-1451-4221-b331-e109733ab471 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e26cfc36-f3d7-414c-ad2a-99baf076125c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:56 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e26cfc36-f3d7-414c-ad2a-99baf076125c Sep 25 17:15:56 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:56 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-676d4df0-1451-4221-b331-e109733ab471 tempest-VolumesGetTest-1429595378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e26cfc36-f3d7-414c-ad2a-99baf076125c" returned: 0 in 0.466s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-676d4df0-1451-4221-b331-e109733ab471 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e26cfc36-f3d7-414c-ad2a-99baf076125c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:56 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e26cfc36-f3d7-414c-ad2a-99baf076125c Sep 25 17:15:56 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:57 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-676d4df0-1451-4221-b331-e109733ab471 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e26cfc36-f3d7-414c-ad2a-99baf076125c" returned: 0 in 0.486s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-676d4df0-1451-4221-b331-e109733ab471 tempest-VolumesGetTest-1429595378 None] Lock "cinder-quobyte-e26cfc36-f3d7-414c-ad2a-99baf076125c" released by "delete_volume" :: held 1.035s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:57 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-676d4df0-1451-4221-b331-e109733ab471 tempest-VolumesGetTest-1429595378 None] Created reservations ['ddb2c0bb-e382-420d-a942-bffc2637fae2', '9c417004-24d7-4277-aa9f-718848f1d505', '540c4031-df34-443c-943b-ac62ef93d0f4', 'd0561eba-2a12-404e-b854-1ff942b8523e'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-676d4df0-1451-4221-b331-e109733ab471 tempest-VolumesGetTest-1429595378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-676d4df0-1451-4221-b331-e109733ab471 tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-676d4df0-1451-4221-b331-e109733ab471 tempest-VolumesGetTest-1429595378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-676d4df0-1451-4221-b331-e109733ab471 tempest-VolumesGetTest-1429595378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-676d4df0-1451-4221-b331-e109733ab471 tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-676d4df0-1451-4221-b331-e109733ab471 tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:57 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:15:57 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:58 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-676d4df0-1451-4221-b331-e109733ab471 tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.489s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:58 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-676d4df0-1451-4221-b331-e109733ab471 tempest-VolumesGetTest-1429595378 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:58 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-676d4df0-1451-4221-b331-e109733ab471 tempest-VolumesGetTest-1429595378 None] Deleted volume successfully. Sep 25 17:15:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-676d4df0-1451-4221-b331-e109733ab471 tempest-VolumesGetTest-1429595378 None] Lock "cinder-e26cfc36-f3d7-414c-ad2a-99baf076125c-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-281ed693-5a99-4885-bba5-f9cf9da675ba tempest-VolumesGetTest-1429595378 None] Acquiring lock "cinder-b28afe67-af1a-481f-9d04-7972ba6da58e-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-281ed693-5a99-4885-bba5-f9cf9da675ba tempest-VolumesGetTest-1429595378 None] Lock "cinder-b28afe67-af1a-481f-9d04-7972ba6da58e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-281ed693-5a99-4885-bba5-f9cf9da675ba tempest-VolumesGetTest-1429595378 None] Acquiring lock "cinder-quobyte-b28afe67-af1a-481f-9d04-7972ba6da58e" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-281ed693-5a99-4885-bba5-f9cf9da675ba tempest-VolumesGetTest-1429595378 None] Lock "cinder-quobyte-b28afe67-af1a-481f-9d04-7972ba6da58e" acquired by "delete_volume" :: waited 0.039s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:58 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea8c9d0-38f9-4c2d-b773-23432498c7f1]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-281ed693-5a99-4885-bba5-f9cf9da675ba tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b28afe67-af1a-481f-9d04-7972ba6da58e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:59 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b28afe67-af1a-481f-9d04-7972ba6da58e Sep 25 17:15:59 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:59 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-281ed693-5a99-4885-bba5-f9cf9da675ba tempest-VolumesGetTest-1429595378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b28afe67-af1a-481f-9d04-7972ba6da58e" returned: 0 in 0.563s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-281ed693-5a99-4885-bba5-f9cf9da675ba tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b28afe67-af1a-481f-9d04-7972ba6da58e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:59 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b28afe67-af1a-481f-9d04-7972ba6da58e Sep 25 17:15:59 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:59 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-281ed693-5a99-4885-bba5-f9cf9da675ba tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b28afe67-af1a-481f-9d04-7972ba6da58e" returned: 0 in 0.388s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-281ed693-5a99-4885-bba5-f9cf9da675ba tempest-VolumesGetTest-1429595378 None] Lock "cinder-quobyte-b28afe67-af1a-481f-9d04-7972ba6da58e" released by "delete_volume" :: held 1.061s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:59 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-281ed693-5a99-4885-bba5-f9cf9da675ba tempest-VolumesGetTest-1429595378 None] Created reservations ['50a2beb4-f70f-408a-9f48-bd625d115dd1', '5a15cce2-fcad-4003-b2ff-766618954abc', '33bd640f-2e6a-4702-a1cb-22f888547ec5', '8c83c1c9-30d3-4021-a266-dcc9db6f0eb4'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:16:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-281ed693-5a99-4885-bba5-f9cf9da675ba tempest-VolumesGetTest-1429595378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-281ed693-5a99-4885-bba5-f9cf9da675ba tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:00 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-281ed693-5a99-4885-bba5-f9cf9da675ba tempest-VolumesGetTest-1429595378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:00 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-281ed693-5a99-4885-bba5-f9cf9da675ba tempest-VolumesGetTest-1429595378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-281ed693-5a99-4885-bba5-f9cf9da675ba tempest-VolumesGetTest-1429595378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-281ed693-5a99-4885-bba5-f9cf9da675ba tempest-VolumesGetTest-1429595378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:00 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:16:00 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:00 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-281ed693-5a99-4885-bba5-f9cf9da675ba tempest-VolumesGetTest-1429595378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.394s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:00 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-281ed693-5a99-4885-bba5-f9cf9da675ba tempest-VolumesGetTest-1429595378 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:00 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-281ed693-5a99-4885-bba5-f9cf9da675ba tempest-VolumesGetTest-1429595378 None] Deleted volume successfully. Sep 25 17:16:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-281ed693-5a99-4885-bba5-f9cf9da675ba tempest-VolumesGetTest-1429595378 None] Lock "cinder-b28afe67-af1a-481f-9d04-7972ba6da58e-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:03 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-3e91cfa1-c7fa-4d71-af69-f3124fd19cb1 req-d6b31d8c-eaae-4f11-bd24-eb1a93228f87 tempest-AttachVolumeNegativeTest-878525210 None] Terminate volume connection completed successfully. Sep 25 17:16:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-3e91cfa1-c7fa-4d71-af69-f3124fd19cb1 req-d6b31d8c-eaae-4f11-bd24-eb1a93228f87 tempest-AttachVolumeNegativeTest-878525210 None] Deleting attachment 0ad57cd0-0709-40ee-8fce-a62297c8fddf. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:16:13 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:UPDATE=61,cinder:INSERT=19,cinder:DELETE=7,cinder:SELECT=40 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:16:13 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:UPDATE=59,cinder:SELECT=49,cinder:INSERT=20,cinder:DELETE=4 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:16:14 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:16:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Flow 'volume_create_manager' (89fb2316-a270-4e28-b3aa-42ad47690808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e86d6a-8dbe-4128-beef-2457dcdb406d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e86d6a-8dbe-4128-beef-2457dcdb406d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-328532198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f528b70b-6cb7-4c0c-a089-ae9987d08d48,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d18a580b32004c9489054e60c87ec385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:14Z,use_quota=True,user_id='b89817d4fdbe4220a629cdc1c7e7c9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34570c60-3469-4ada-8a96-1ba18c7c17ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34570c60-3469-4ada-8a96-1ba18c7c17ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638e0bad-ef3f-4689-8527-765ef59f8432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638e0bad-ef3f-4689-8527-765ef59f8432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f528b70b-6cb7-4c0c-a089-ae9987d08d48', 'volume_name': 'volume-f528b70b-6cb7-4c0c-a089-ae9987d08d48', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a92f9a-3075-4264-a988-dfafd764fedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a92f9a-3075-4264-a988-dfafd764fedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3afbdc-f665-4857-a891-b28f241315f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:14 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Volume f528b70b-6cb7-4c0c-a089-ae9987d08d48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f528b70b-6cb7-4c0c-a089-ae9987d08d48', 'volume_size': 1} Sep 25 17:16:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-328532198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f528b70b-6cb7-4c0c-a089-ae9987d08d48,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d18a580b32004c9489054e60c87ec385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:14Z,use_quota=True,user_id='b89817d4fdbe4220a629cdc1c7e7c9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:16:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Creating volume f528b70b-6cb7-4c0c-a089-ae9987d08d48 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:16:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:16:14 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:16:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f528b70b-6cb7-4c0c-a089-ae9987d08d48 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:14 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f528b70b-6cb7-4c0c-a089-ae9987d08d48 1073741824 Sep 25 17:16:14 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:15 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f528b70b-6cb7-4c0c-a089-ae9987d08d48 1073741824" returned: 0 in 0.604s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f528b70b-6cb7-4c0c-a089-ae9987d08d48 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:15 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f528b70b-6cb7-4c0c-a089-ae9987d08d48 Sep 25 17:16:15 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:15 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f528b70b-6cb7-4c0c-a089-ae9987d08d48" returned: 0 in 0.368s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:16:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3afbdc-f665-4857-a891-b28f241315f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f528b70b-6cb7-4c0c-a089-ae9987d08d48', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fafe1111-f161-4b6b-8b8d-01361231cc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:15 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Volume volume-f528b70b-6cb7-4c0c-a089-ae9987d08d48 (f528b70b-6cb7-4c0c-a089-ae9987d08d48): created successfully Sep 25 17:16:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fafe1111-f161-4b6b-8b8d-01361231cc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Flow 'volume_create_manager' (89fb2316-a270-4e28-b3aa-42ad47690808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:15 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-3239bf03-791c-42e2-9a98-2431df5f507c tempest-VolumesListTestJSON-805562693 None] Created volume successfully. Sep 25 17:16:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-4ce3454d-30b2-4813-9ad2-2f28f7e2c8c9 req-40a5502e-f0e1-4bc4-b631-106a19627185 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-4ce3454d-30b2-4813-9ad2-2f28f7e2c8c9 req-40a5502e-f0e1-4bc4-b631-106a19627185 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-4ce3454d-30b2-4813-9ad2-2f28f7e2c8c9 req-40a5502e-f0e1-4bc4-b631-106a19627185 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-4ce3454d-30b2-4813-9ad2-2f28f7e2c8c9 req-40a5502e-f0e1-4bc4-b631-106a19627185 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-4e18832f-0932-46da-bc42-b9f151190be1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c48b59b-4195-461e-a400-88cc3df0cbe4', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:16:16 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-4ce3454d-30b2-4813-9ad2-2f28f7e2c8c9 req-40a5502e-f0e1-4bc4-b631-106a19627185 tempest-TestServerVolumeAttachmentScenario-2115173390 None] attachment_update completed successfully. Sep 25 17:16:17 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:16:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Flow 'volume_create_manager' (232e4dad-ba07-4b72-a62a-856cf5fd4ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c346f2d-dd72-4676-8dec-86972cb7de79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c346f2d-dd72-4676-8dec-86972cb7de79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1707598701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57cb590-393c-4d55-9065-8b3633432e73,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d18a580b32004c9489054e60c87ec385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:18Z,use_quota=True,user_id='b89817d4fdbe4220a629cdc1c7e7c9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9dc5048-dad4-4a18-955c-42044ea1d472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9dc5048-dad4-4a18-955c-42044ea1d472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fdb2674-0026-4b2d-ac70-7a6d00f88b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fdb2674-0026-4b2d-ac70-7a6d00f88b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e57cb590-393c-4d55-9065-8b3633432e73', 'volume_name': 'volume-e57cb590-393c-4d55-9065-8b3633432e73', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ff0332-e4c3-48cf-b155-980a7bb362b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ff0332-e4c3-48cf-b155-980a7bb362b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70cc76b0-810e-4e44-8deb-9907a37961a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:17 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Volume e57cb590-393c-4d55-9065-8b3633432e73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e57cb590-393c-4d55-9065-8b3633432e73', 'volume_size': 1} Sep 25 17:16:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1707598701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57cb590-393c-4d55-9065-8b3633432e73,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d18a580b32004c9489054e60c87ec385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:18Z,use_quota=True,user_id='b89817d4fdbe4220a629cdc1c7e7c9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:16:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Creating volume e57cb590-393c-4d55-9065-8b3633432e73 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:16:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:16:17 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:16:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e57cb590-393c-4d55-9065-8b3633432e73 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:17 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e57cb590-393c-4d55-9065-8b3633432e73 1073741824 Sep 25 17:16:17 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:18 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e57cb590-393c-4d55-9065-8b3633432e73 1073741824" returned: 0 in 0.958s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e57cb590-393c-4d55-9065-8b3633432e73 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:18 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e57cb590-393c-4d55-9065-8b3633432e73 Sep 25 17:16:18 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:19 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e57cb590-393c-4d55-9065-8b3633432e73" returned: 0 in 0.389s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:16:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70cc76b0-810e-4e44-8deb-9907a37961a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e57cb590-393c-4d55-9065-8b3633432e73', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f2fa637-6d50-476b-a74d-92533661f787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:19 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Volume volume-e57cb590-393c-4d55-9065-8b3633432e73 (e57cb590-393c-4d55-9065-8b3633432e73): created successfully Sep 25 17:16:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f2fa637-6d50-476b-a74d-92533661f787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Flow 'volume_create_manager' (232e4dad-ba07-4b72-a62a-856cf5fd4ebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:19 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-d55fcfbc-aa1f-4a3f-ace3-a0f89a33b3ef tempest-VolumesListTestJSON-805562693 None] Created volume successfully. Sep 25 17:16:20 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:16:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Flow 'volume_create_manager' (29927910-2540-4152-88be-d7aa505f240f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec6e0ed-158c-4c1d-9c90-1560a57e5ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec6e0ed-158c-4c1d-9c90-1560a57e5ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-533079674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e139240-ea47-47fb-9d8a-e5e9ec312398,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d18a580b32004c9489054e60c87ec385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:21Z,use_quota=True,user_id='b89817d4fdbe4220a629cdc1c7e7c9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5558bd7d-e2d1-456b-b885-a8777fcecca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5558bd7d-e2d1-456b-b885-a8777fcecca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a643fecb-b043-4fe6-826c-cc5ee76f93b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a643fecb-b043-4fe6-826c-cc5ee76f93b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e139240-ea47-47fb-9d8a-e5e9ec312398', 'volume_name': 'volume-7e139240-ea47-47fb-9d8a-e5e9ec312398', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbddb833-44f9-4da5-8ac1-ab0100380a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbddb833-44f9-4da5-8ac1-ab0100380a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503b8e0f-4a54-4bc0-a632-dc368fe3250d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:20 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Volume 7e139240-ea47-47fb-9d8a-e5e9ec312398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e139240-ea47-47fb-9d8a-e5e9ec312398', 'volume_size': 1} Sep 25 17:16:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:20 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-533079674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e139240-ea47-47fb-9d8a-e5e9ec312398,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d18a580b32004c9489054e60c87ec385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:21Z,use_quota=True,user_id='b89817d4fdbe4220a629cdc1c7e7c9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:16:20 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Creating volume 7e139240-ea47-47fb-9d8a-e5e9ec312398 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:16:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:20 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:20 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:20 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:16:20 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:16:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7e139240-ea47-47fb-9d8a-e5e9ec312398 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:20 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7e139240-ea47-47fb-9d8a-e5e9ec312398 1073741824 Sep 25 17:16:20 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:21 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7e139240-ea47-47fb-9d8a-e5e9ec312398 1073741824" returned: 0 in 0.656s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7e139240-ea47-47fb-9d8a-e5e9ec312398 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:21 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7e139240-ea47-47fb-9d8a-e5e9ec312398 Sep 25 17:16:21 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:22 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7e139240-ea47-47fb-9d8a-e5e9ec312398" returned: 0 in 0.477s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:16:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503b8e0f-4a54-4bc0-a632-dc368fe3250d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e139240-ea47-47fb-9d8a-e5e9ec312398', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14807163-4bfb-4ab0-8d91-ad0be6af032d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:22 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Volume volume-7e139240-ea47-47fb-9d8a-e5e9ec312398 (7e139240-ea47-47fb-9d8a-e5e9ec312398): created successfully Sep 25 17:16:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14807163-4bfb-4ab0-8d91-ad0be6af032d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Flow 'volume_create_manager' (29927910-2540-4152-88be-d7aa505f240f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:22 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-04dde2a5-e4da-4613-932c-398960e720d3 tempest-VolumesListTestJSON-805562693 None] Created volume successfully. Sep 25 17:16:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-125fa5d4-eb93-48c8-bf93-051ecae2f3c4 req-5b7caa44-aecd-4eed-9fd3-4e8b13ebd4bf tempest-TestServerVolumeAttachmentScenario-2115173390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-125fa5d4-eb93-48c8-bf93-051ecae2f3c4 req-5b7caa44-aecd-4eed-9fd3-4e8b13ebd4bf tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-125fa5d4-eb93-48c8-bf93-051ecae2f3c4 req-5b7caa44-aecd-4eed-9fd3-4e8b13ebd4bf tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-125fa5d4-eb93-48c8-bf93-051ecae2f3c4 req-5b7caa44-aecd-4eed-9fd3-4e8b13ebd4bf tempest-TestServerVolumeAttachmentScenario-2115173390 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-a06bf078-4578-404f-93a8-ac4337f8ea21', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0de1e46-2f17-4d01-880e-f5694767aa25', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:16:27 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-125fa5d4-eb93-48c8-bf93-051ecae2f3c4 req-5b7caa44-aecd-4eed-9fd3-4e8b13ebd4bf tempest-TestServerVolumeAttachmentScenario-2115173390 None] attachment_update completed successfully. Sep 25 17:16:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3a5f7734-2639-41d3-ae1f-2f42c1a89289 tempest-VolumesListTestJSON-805562693 None] Acquiring lock "cinder-7e139240-ea47-47fb-9d8a-e5e9ec312398-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3a5f7734-2639-41d3-ae1f-2f42c1a89289 tempest-VolumesListTestJSON-805562693 None] Lock "cinder-7e139240-ea47-47fb-9d8a-e5e9ec312398-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3a5f7734-2639-41d3-ae1f-2f42c1a89289 tempest-VolumesListTestJSON-805562693 None] Acquiring lock "cinder-quobyte-7e139240-ea47-47fb-9d8a-e5e9ec312398" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3a5f7734-2639-41d3-ae1f-2f42c1a89289 tempest-VolumesListTestJSON-805562693 None] Lock "cinder-quobyte-7e139240-ea47-47fb-9d8a-e5e9ec312398" acquired by "delete_volume" :: waited 0.045s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:29 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5f983d-d3a9-48d9-a11d-236f1ded3f5f]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3a5f7734-2639-41d3-ae1f-2f42c1a89289 tempest-VolumesListTestJSON-805562693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7e139240-ea47-47fb-9d8a-e5e9ec312398 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:29 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7e139240-ea47-47fb-9d8a-e5e9ec312398 Sep 25 17:16:29 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:30 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3a5f7734-2639-41d3-ae1f-2f42c1a89289 tempest-VolumesListTestJSON-805562693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7e139240-ea47-47fb-9d8a-e5e9ec312398" returned: 0 in 0.721s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3a5f7734-2639-41d3-ae1f-2f42c1a89289 tempest-VolumesListTestJSON-805562693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7e139240-ea47-47fb-9d8a-e5e9ec312398 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:30 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7e139240-ea47-47fb-9d8a-e5e9ec312398 Sep 25 17:16:30 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:30 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3a5f7734-2639-41d3-ae1f-2f42c1a89289 tempest-VolumesListTestJSON-805562693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7e139240-ea47-47fb-9d8a-e5e9ec312398" returned: 0 in 0.601s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3a5f7734-2639-41d3-ae1f-2f42c1a89289 tempest-VolumesListTestJSON-805562693 None] Lock "cinder-quobyte-7e139240-ea47-47fb-9d8a-e5e9ec312398" released by "delete_volume" :: held 1.462s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:30 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-3a5f7734-2639-41d3-ae1f-2f42c1a89289 tempest-VolumesListTestJSON-805562693 None] Created reservations ['172ed722-33fc-4f1b-bcde-5606e927bbfb', '7e704053-963d-4100-aa37-2bb6045e8b4b', '392562e3-e8cf-4129-bf97-3b7c81a04148', 'c0f212b4-ab64-4268-8923-fde9a0b2461b'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:16:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3a5f7734-2639-41d3-ae1f-2f42c1a89289 tempest-VolumesListTestJSON-805562693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3a5f7734-2639-41d3-ae1f-2f42c1a89289 tempest-VolumesListTestJSON-805562693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:31 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3a5f7734-2639-41d3-ae1f-2f42c1a89289 tempest-VolumesListTestJSON-805562693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:31 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3a5f7734-2639-41d3-ae1f-2f42c1a89289 tempest-VolumesListTestJSON-805562693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3a5f7734-2639-41d3-ae1f-2f42c1a89289 tempest-VolumesListTestJSON-805562693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3a5f7734-2639-41d3-ae1f-2f42c1a89289 tempest-VolumesListTestJSON-805562693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:31 devstack sudo[100924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:16:31 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:31 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3a5f7734-2639-41d3-ae1f-2f42c1a89289 tempest-VolumesListTestJSON-805562693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.550s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:31 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-3a5f7734-2639-41d3-ae1f-2f42c1a89289 tempest-VolumesListTestJSON-805562693 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:31 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-3a5f7734-2639-41d3-ae1f-2f42c1a89289 tempest-VolumesListTestJSON-805562693 None] Deleted volume successfully. Sep 25 17:16:31 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3a5f7734-2639-41d3-ae1f-2f42c1a89289 tempest-VolumesListTestJSON-805562693 None] Lock "cinder-7e139240-ea47-47fb-9d8a-e5e9ec312398-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:31 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1ddd2462-780c-4b25-af1b-be1afd9f0aa9 tempest-VolumesListTestJSON-805562693 None] Acquiring lock "cinder-e57cb590-393c-4d55-9065-8b3633432e73-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1ddd2462-780c-4b25-af1b-be1afd9f0aa9 tempest-VolumesListTestJSON-805562693 None] Lock "cinder-e57cb590-393c-4d55-9065-8b3633432e73-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1ddd2462-780c-4b25-af1b-be1afd9f0aa9 tempest-VolumesListTestJSON-805562693 None] Acquiring lock "cinder-quobyte-e57cb590-393c-4d55-9065-8b3633432e73" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:32 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-e954e01e-7932-459f-a640-06d8955e3976 req-2931573a-ac13-4396-ad2c-6ec06f6c0d14 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Terminate volume connection completed successfully. Sep 25 17:16:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-e954e01e-7932-459f-a640-06d8955e3976 req-2931573a-ac13-4396-ad2c-6ec06f6c0d14 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Deleting attachment e0de1e46-2f17-4d01-880e-f5694767aa25. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:16:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1ddd2462-780c-4b25-af1b-be1afd9f0aa9 tempest-VolumesListTestJSON-805562693 None] Lock "cinder-quobyte-e57cb590-393c-4d55-9065-8b3633432e73" acquired by "delete_volume" :: waited 0.042s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:32 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[8576c00f-6fbe-4d6f-9eeb-c297f7ecc771]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1ddd2462-780c-4b25-af1b-be1afd9f0aa9 tempest-VolumesListTestJSON-805562693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e57cb590-393c-4d55-9065-8b3633432e73 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:32 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e57cb590-393c-4d55-9065-8b3633432e73 Sep 25 17:16:32 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:33 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1ddd2462-780c-4b25-af1b-be1afd9f0aa9 tempest-VolumesListTestJSON-805562693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e57cb590-393c-4d55-9065-8b3633432e73" returned: 0 in 0.932s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1ddd2462-780c-4b25-af1b-be1afd9f0aa9 tempest-VolumesListTestJSON-805562693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e57cb590-393c-4d55-9065-8b3633432e73 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:33 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e57cb590-393c-4d55-9065-8b3633432e73 Sep 25 17:16:33 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:33 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1ddd2462-780c-4b25-af1b-be1afd9f0aa9 tempest-VolumesListTestJSON-805562693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e57cb590-393c-4d55-9065-8b3633432e73" returned: 0 in 0.457s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1ddd2462-780c-4b25-af1b-be1afd9f0aa9 tempest-VolumesListTestJSON-805562693 None] Lock "cinder-quobyte-e57cb590-393c-4d55-9065-8b3633432e73" released by "delete_volume" :: held 1.519s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:33 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-1ddd2462-780c-4b25-af1b-be1afd9f0aa9 tempest-VolumesListTestJSON-805562693 None] Created reservations ['8fc2b5a1-53a2-43a1-b785-12fb5cb7eb6d', 'e9641c41-c0d3-4e0b-b8b5-e60f9d0230b5', '9677b137-42e3-475f-8fa4-b3241ca9bed4', 'ee716b71-dd7d-4aae-b93d-6660a10deb70'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:16:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1ddd2462-780c-4b25-af1b-be1afd9f0aa9 tempest-VolumesListTestJSON-805562693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1ddd2462-780c-4b25-af1b-be1afd9f0aa9 tempest-VolumesListTestJSON-805562693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1ddd2462-780c-4b25-af1b-be1afd9f0aa9 tempest-VolumesListTestJSON-805562693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1ddd2462-780c-4b25-af1b-be1afd9f0aa9 tempest-VolumesListTestJSON-805562693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1ddd2462-780c-4b25-af1b-be1afd9f0aa9 tempest-VolumesListTestJSON-805562693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1ddd2462-780c-4b25-af1b-be1afd9f0aa9 tempest-VolumesListTestJSON-805562693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:34 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:16:34 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:34 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1ddd2462-780c-4b25-af1b-be1afd9f0aa9 tempest-VolumesListTestJSON-805562693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.550s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:34 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-1ddd2462-780c-4b25-af1b-be1afd9f0aa9 tempest-VolumesListTestJSON-805562693 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:34 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-1ddd2462-780c-4b25-af1b-be1afd9f0aa9 tempest-VolumesListTestJSON-805562693 None] Deleted volume successfully. Sep 25 17:16:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1ddd2462-780c-4b25-af1b-be1afd9f0aa9 tempest-VolumesListTestJSON-805562693 None] Lock "cinder-e57cb590-393c-4d55-9065-8b3633432e73-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7cd0a7af-3d1c-45f3-88d6-3f751ac1a7d6 tempest-VolumesListTestJSON-805562693 None] Acquiring lock "cinder-f528b70b-6cb7-4c0c-a089-ae9987d08d48-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7cd0a7af-3d1c-45f3-88d6-3f751ac1a7d6 tempest-VolumesListTestJSON-805562693 None] Lock "cinder-f528b70b-6cb7-4c0c-a089-ae9987d08d48-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7cd0a7af-3d1c-45f3-88d6-3f751ac1a7d6 tempest-VolumesListTestJSON-805562693 None] Acquiring lock "cinder-quobyte-f528b70b-6cb7-4c0c-a089-ae9987d08d48" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7cd0a7af-3d1c-45f3-88d6-3f751ac1a7d6 tempest-VolumesListTestJSON-805562693 None] Lock "cinder-quobyte-f528b70b-6cb7-4c0c-a089-ae9987d08d48" acquired by "delete_volume" :: waited 0.034s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:34 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[28055767-0d79-4a61-b87b-d591b38f72a6]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7cd0a7af-3d1c-45f3-88d6-3f751ac1a7d6 tempest-VolumesListTestJSON-805562693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f528b70b-6cb7-4c0c-a089-ae9987d08d48 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:35 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f528b70b-6cb7-4c0c-a089-ae9987d08d48 Sep 25 17:16:35 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:35 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-5b81adf9-918b-4002-8357-dabe40f809dc req-600fa439-f6bd-4b8c-b0ac-6f9a1084a1cd tempest-TestServerVolumeAttachmentScenario-2115173390 None] Terminate volume connection completed successfully. Sep 25 17:16:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-5b81adf9-918b-4002-8357-dabe40f809dc req-600fa439-f6bd-4b8c-b0ac-6f9a1084a1cd tempest-TestServerVolumeAttachmentScenario-2115173390 None] Deleting attachment 8c48b59b-4195-461e-a400-88cc3df0cbe4. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:16:35 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7cd0a7af-3d1c-45f3-88d6-3f751ac1a7d6 tempest-VolumesListTestJSON-805562693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f528b70b-6cb7-4c0c-a089-ae9987d08d48" returned: 0 in 0.898s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7cd0a7af-3d1c-45f3-88d6-3f751ac1a7d6 tempest-VolumesListTestJSON-805562693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f528b70b-6cb7-4c0c-a089-ae9987d08d48 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:35 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f528b70b-6cb7-4c0c-a089-ae9987d08d48 Sep 25 17:16:35 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:36 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7cd0a7af-3d1c-45f3-88d6-3f751ac1a7d6 tempest-VolumesListTestJSON-805562693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f528b70b-6cb7-4c0c-a089-ae9987d08d48" returned: 0 in 0.343s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7cd0a7af-3d1c-45f3-88d6-3f751ac1a7d6 tempest-VolumesListTestJSON-805562693 None] Lock "cinder-quobyte-f528b70b-6cb7-4c0c-a089-ae9987d08d48" released by "delete_volume" :: held 1.329s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:36 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-7cd0a7af-3d1c-45f3-88d6-3f751ac1a7d6 tempest-VolumesListTestJSON-805562693 None] Created reservations ['e4fb76a4-c38c-4b0e-8a91-908903a13b8c', '4b0be437-77cb-4663-907a-c1a174f6c6cb', '1b77f01f-dc89-45a6-89f9-f29e9dd4ddce', 'fc701590-85a0-44a6-a466-a2d9e4d16f4e'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:16:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7cd0a7af-3d1c-45f3-88d6-3f751ac1a7d6 tempest-VolumesListTestJSON-805562693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7cd0a7af-3d1c-45f3-88d6-3f751ac1a7d6 tempest-VolumesListTestJSON-805562693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7cd0a7af-3d1c-45f3-88d6-3f751ac1a7d6 tempest-VolumesListTestJSON-805562693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7cd0a7af-3d1c-45f3-88d6-3f751ac1a7d6 tempest-VolumesListTestJSON-805562693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7cd0a7af-3d1c-45f3-88d6-3f751ac1a7d6 tempest-VolumesListTestJSON-805562693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7cd0a7af-3d1c-45f3-88d6-3f751ac1a7d6 tempest-VolumesListTestJSON-805562693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:36 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:16:36 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:36 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7cd0a7af-3d1c-45f3-88d6-3f751ac1a7d6 tempest-VolumesListTestJSON-805562693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.375s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:36 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-7cd0a7af-3d1c-45f3-88d6-3f751ac1a7d6 tempest-VolumesListTestJSON-805562693 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:36 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-7cd0a7af-3d1c-45f3-88d6-3f751ac1a7d6 tempest-VolumesListTestJSON-805562693 None] Deleted volume successfully. Sep 25 17:16:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7cd0a7af-3d1c-45f3-88d6-3f751ac1a7d6 tempest-VolumesListTestJSON-805562693 None] Lock "cinder-f528b70b-6cb7-4c0c-a089-ae9987d08d48-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-bf98f794-36af-4912-98b9-2cd50dc9cc81 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Acquiring lock "cinder-a06bf078-4578-404f-93a8-ac4337f8ea21-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-bf98f794-36af-4912-98b9-2cd50dc9cc81 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "cinder-a06bf078-4578-404f-93a8-ac4337f8ea21-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-bf98f794-36af-4912-98b9-2cd50dc9cc81 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Acquiring lock "cinder-quobyte-a06bf078-4578-404f-93a8-ac4337f8ea21" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-bf98f794-36af-4912-98b9-2cd50dc9cc81 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "cinder-quobyte-a06bf078-4578-404f-93a8-ac4337f8ea21" acquired by "delete_volume" :: waited 0.044s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:42 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81f2e6e-009f-4eee-b875-0de27ab82b85]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bf98f794-36af-4912-98b9-2cd50dc9cc81 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a06bf078-4578-404f-93a8-ac4337f8ea21 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:42 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a06bf078-4578-404f-93a8-ac4337f8ea21 Sep 25 17:16:42 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:42 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bf98f794-36af-4912-98b9-2cd50dc9cc81 tempest-TestServerVolumeAttachmentScenario-2115173390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a06bf078-4578-404f-93a8-ac4337f8ea21" returned: 0 in 0.615s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bf98f794-36af-4912-98b9-2cd50dc9cc81 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a06bf078-4578-404f-93a8-ac4337f8ea21 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:42 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a06bf078-4578-404f-93a8-ac4337f8ea21 Sep 25 17:16:42 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:43 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bf98f794-36af-4912-98b9-2cd50dc9cc81 tempest-TestServerVolumeAttachmentScenario-2115173390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a06bf078-4578-404f-93a8-ac4337f8ea21" returned: 0 in 0.444s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-bf98f794-36af-4912-98b9-2cd50dc9cc81 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "cinder-quobyte-a06bf078-4578-404f-93a8-ac4337f8ea21" released by "delete_volume" :: held 1.133s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:43 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-bf98f794-36af-4912-98b9-2cd50dc9cc81 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Created reservations ['7a6a0e32-fe1b-4970-b322-751d281efed2', '2ccc74ca-f6fa-4200-85c3-4ce78cd7a3c8', '7f81c43b-dd88-4325-9d0d-e833a0d6bf03', 'f72b7603-7d85-4742-a642-151503c7127a'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:16:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bf98f794-36af-4912-98b9-2cd50dc9cc81 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bf98f794-36af-4912-98b9-2cd50dc9cc81 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-bf98f794-36af-4912-98b9-2cd50dc9cc81 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-bf98f794-36af-4912-98b9-2cd50dc9cc81 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bf98f794-36af-4912-98b9-2cd50dc9cc81 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bf98f794-36af-4912-98b9-2cd50dc9cc81 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:43 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:16:43 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:43 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bf98f794-36af-4912-98b9-2cd50dc9cc81 tempest-TestServerVolumeAttachmentScenario-2115173390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.326s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:43 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-bf98f794-36af-4912-98b9-2cd50dc9cc81 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:43 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-bf98f794-36af-4912-98b9-2cd50dc9cc81 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Deleted volume successfully. Sep 25 17:16:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-bf98f794-36af-4912-98b9-2cd50dc9cc81 tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "cinder-a06bf078-4578-404f-93a8-ac4337f8ea21-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:44 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-13d84193-0372-4b4f-bc35-d87a8a57de8b tempest-TestServerVolumeAttachmentScenario-2115173390 None] Acquiring lock "cinder-4e18832f-0932-46da-bc42-b9f151190be1-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:44 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-13d84193-0372-4b4f-bc35-d87a8a57de8b tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "cinder-4e18832f-0932-46da-bc42-b9f151190be1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:44 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-13d84193-0372-4b4f-bc35-d87a8a57de8b tempest-TestServerVolumeAttachmentScenario-2115173390 None] Acquiring lock "cinder-quobyte-4e18832f-0932-46da-bc42-b9f151190be1" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:44 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-13d84193-0372-4b4f-bc35-d87a8a57de8b tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "cinder-quobyte-4e18832f-0932-46da-bc42-b9f151190be1" acquired by "delete_volume" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:44 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[70788084-22f5-44c4-b014-9e638b0b83c9]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-13d84193-0372-4b4f-bc35-d87a8a57de8b tempest-TestServerVolumeAttachmentScenario-2115173390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4e18832f-0932-46da-bc42-b9f151190be1 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:44 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4e18832f-0932-46da-bc42-b9f151190be1 Sep 25 17:16:44 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:45 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-13d84193-0372-4b4f-bc35-d87a8a57de8b tempest-TestServerVolumeAttachmentScenario-2115173390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4e18832f-0932-46da-bc42-b9f151190be1" returned: 0 in 0.409s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-13d84193-0372-4b4f-bc35-d87a8a57de8b tempest-TestServerVolumeAttachmentScenario-2115173390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4e18832f-0932-46da-bc42-b9f151190be1 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:45 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4e18832f-0932-46da-bc42-b9f151190be1 Sep 25 17:16:45 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:45 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-13d84193-0372-4b4f-bc35-d87a8a57de8b tempest-TestServerVolumeAttachmentScenario-2115173390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4e18832f-0932-46da-bc42-b9f151190be1" returned: 0 in 0.262s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-13d84193-0372-4b4f-bc35-d87a8a57de8b tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "cinder-quobyte-4e18832f-0932-46da-bc42-b9f151190be1" released by "delete_volume" :: held 0.716s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:45 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-13d84193-0372-4b4f-bc35-d87a8a57de8b tempest-TestServerVolumeAttachmentScenario-2115173390 None] Created reservations ['e25489b4-8ce9-4af8-bde5-7a3e1d33a805', 'ad499295-e4f5-4b0b-9b12-75687ed23ce2', 'a0fb233a-a855-4a7f-8bb9-add5278211ca', '8d61a97a-8bec-43ca-ba4f-b571ef09983b'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:16:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-13d84193-0372-4b4f-bc35-d87a8a57de8b tempest-TestServerVolumeAttachmentScenario-2115173390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-13d84193-0372-4b4f-bc35-d87a8a57de8b tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-13d84193-0372-4b4f-bc35-d87a8a57de8b tempest-TestServerVolumeAttachmentScenario-2115173390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-13d84193-0372-4b4f-bc35-d87a8a57de8b tempest-TestServerVolumeAttachmentScenario-2115173390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-13d84193-0372-4b4f-bc35-d87a8a57de8b tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-13d84193-0372-4b4f-bc35-d87a8a57de8b tempest-TestServerVolumeAttachmentScenario-2115173390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:45 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:16:45 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:45 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-13d84193-0372-4b4f-bc35-d87a8a57de8b tempest-TestServerVolumeAttachmentScenario-2115173390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.269s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:45 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-13d84193-0372-4b4f-bc35-d87a8a57de8b tempest-TestServerVolumeAttachmentScenario-2115173390 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:45 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-13d84193-0372-4b4f-bc35-d87a8a57de8b tempest-TestServerVolumeAttachmentScenario-2115173390 None] Deleted volume successfully. Sep 25 17:16:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-13d84193-0372-4b4f-bc35-d87a8a57de8b tempest-TestServerVolumeAttachmentScenario-2115173390 None] Lock "cinder-4e18832f-0932-46da-bc42-b9f151190be1-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:16:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:53 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:16:53 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:54 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.472s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 28 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Flow 'volume_create_manager' (4d48c9d6-5d99-4d76-9fa5-4b243b8da4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c2be2ed-5117-4835-8eda-087a1c10ebe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c2be2ed-5117-4835-8eda-087a1c10ebe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-431642738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baca0f8e-f1ad-4703-8d06-631f3dda3cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99098d0616604af2835ca5288cf418c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:54Z,use_quota=True,user_id='b9d54ce3b95f45f39f94a396a20bb272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d588f25-dce0-48b2-ac3e-50a3966b46de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d588f25-dce0-48b2-ac3e-50a3966b46de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76bf24a5-b5d1-4624-9fcf-4821599a0f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76bf24a5-b5d1-4624-9fcf-4821599a0f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baca0f8e-f1ad-4703-8d06-631f3dda3cc2', 'volume_name': 'volume-baca0f8e-f1ad-4703-8d06-631f3dda3cc2', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71eb86a4-78cc-466f-8857-a66d00b8363a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71eb86a4-78cc-466f-8857-a66d00b8363a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f613d5-4cdb-4ffb-bfde-e4c080f53201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:54 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Volume baca0f8e-f1ad-4703-8d06-631f3dda3cc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baca0f8e-f1ad-4703-8d06-631f3dda3cc2', 'volume_size': 1} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-431642738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baca0f8e-f1ad-4703-8d06-631f3dda3cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99098d0616604af2835ca5288cf418c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:54Z,use_quota=True,user_id='b9d54ce3b95f45f39f94a396a20bb272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Creating volume baca0f8e-f1ad-4703-8d06-631f3dda3cc2 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:16:54 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:16:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-baca0f8e-f1ad-4703-8d06-631f3dda3cc2 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:54 devstack sudo[101155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-baca0f8e-f1ad-4703-8d06-631f3dda3cc2 1073741824 Sep 25 17:16:54 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:55 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-baca0f8e-f1ad-4703-8d06-631f3dda3cc2 1073741824" returned: 0 in 0.618s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-baca0f8e-f1ad-4703-8d06-631f3dda3cc2 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:55 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-baca0f8e-f1ad-4703-8d06-631f3dda3cc2 Sep 25 17:16:55 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:55 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-baca0f8e-f1ad-4703-8d06-631f3dda3cc2" returned: 0 in 0.290s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:16:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:55 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f613d5-4cdb-4ffb-bfde-e4c080f53201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baca0f8e-f1ad-4703-8d06-631f3dda3cc2', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:55 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d41889-4d95-4f54-99d3-0653d69d8c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:55 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Volume volume-baca0f8e-f1ad-4703-8d06-631f3dda3cc2 (baca0f8e-f1ad-4703-8d06-631f3dda3cc2): created successfully Sep 25 17:16:55 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d41889-4d95-4f54-99d3-0653d69d8c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:55 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Flow 'volume_create_manager' (4d48c9d6-5d99-4d76-9fa5-4b243b8da4ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:55 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-318ca14f-d8a9-4b5f-ae89-cb53301106b1 tempest-AttachVolumeNegativeTest-878525210 None] Created volume successfully. Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Flow 'volume_create_manager' (00596d32-42b1-49eb-85de-00ccac753483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c67101c-bcfb-4e14-be12-419c98a9f508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c67101c-bcfb-4e14-be12-419c98a9f508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-102950178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6e7266-8b45-4737-a1c3-d5e6d812638f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe634641caf4225b76f9c9e08989411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:57Z,use_quota=True,user_id='ce7c600d3ad04c95acc5f6e5edc6638c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e636872-496a-4f10-8f49-96091ad31fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e636872-496a-4f10-8f49-96091ad31fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5595b722-a24b-4717-9b06-b7dd7e8c546f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5595b722-a24b-4717-9b06-b7dd7e8c546f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f6e7266-8b45-4737-a1c3-d5e6d812638f', 'volume_name': 'volume-1f6e7266-8b45-4737-a1c3-d5e6d812638f', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac663e8-c971-408e-bc3f-d92f1ec55df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac663e8-c971-408e-bc3f-d92f1ec55df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d36059-e987-4236-82d3-62252680c7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:57 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Volume 1f6e7266-8b45-4737-a1c3-d5e6d812638f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f6e7266-8b45-4737-a1c3-d5e6d812638f', 'volume_size': 1} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-102950178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6e7266-8b45-4737-a1c3-d5e6d812638f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe634641caf4225b76f9c9e08989411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:57Z,use_quota=True,user_id='ce7c600d3ad04c95acc5f6e5edc6638c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Creating volume 1f6e7266-8b45-4737-a1c3-d5e6d812638f {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:16:57 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1f6e7266-8b45-4737-a1c3-d5e6d812638f 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:57 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1f6e7266-8b45-4737-a1c3-d5e6d812638f 1073741824 Sep 25 17:16:57 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Flow 'volume_create_manager' (574371a6-72b1-4bdb-917f-150be10e3ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54255c66-de8b-46c0-9a00-02e685af1b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54255c66-de8b-46c0-9a00-02e685af1b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-456449298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a2f6a6a-61b5-4a58-9789-c797cc0055b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a82bf8562e4e2ba28ecacf47768e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:58Z,use_quota=True,user_id='d4ca2f2108224c768340557a1c6d2516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189291d9-24fa-4100-aa3a-85bb47a8d23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189291d9-24fa-4100-aa3a-85bb47a8d23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f29565-243c-4697-822b-8a7e9dc13ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f29565-243c-4697-822b-8a7e9dc13ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a2f6a6a-61b5-4a58-9789-c797cc0055b0', 'volume_name': 'volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94bcdd41-2d43-4847-bfa1-496baa26d107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94bcdd41-2d43-4847-bfa1-496baa26d107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934d26bc-630a-46b0-a795-34ab4c2162e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:57 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Volume 4a2f6a6a-61b5-4a58-9789-c797cc0055b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0', 'volume_size': 1} Sep 25 17:16:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-1c59d84b-e929-47d6-b6a7-71f771715f72 req-3fdb8def-aa17-465e-b5fc-778fbdcc6dd5 tempest-AttachVolumeNegativeTest-878525210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:58 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1f6e7266-8b45-4737-a1c3-d5e6d812638f 1073741824" returned: 0 in 0.610s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1f6e7266-8b45-4737-a1c3-d5e6d812638f {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:58 devstack sudo[101186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1f6e7266-8b45-4737-a1c3-d5e6d812638f Sep 25 17:16:58 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:58 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1f6e7266-8b45-4737-a1c3-d5e6d812638f" returned: 0 in 0.285s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:58 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:16:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.480s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:58 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-456449298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a2f6a6a-61b5-4a58-9789-c797cc0055b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a82bf8562e4e2ba28ecacf47768e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:58Z,use_quota=True,user_id='d4ca2f2108224c768340557a1c6d2516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:16:58 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Creating volume 4a2f6a6a-61b5-4a58-9789-c797cc0055b0 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:16:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:58 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:58 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:58 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:16:58 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:16:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:58 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d36059-e987-4236-82d3-62252680c7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f6e7266-8b45-4737-a1c3-d5e6d812638f', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:58 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0 1073741824 Sep 25 17:16:58 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:58 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d331d5-2273-45f1-8eee-1e73b2d3b0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:58 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Volume volume-1f6e7266-8b45-4737-a1c3-d5e6d812638f (1f6e7266-8b45-4737-a1c3-d5e6d812638f): created successfully Sep 25 17:16:58 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d331d5-2273-45f1-8eee-1e73b2d3b0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:58 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Flow 'volume_create_manager' (00596d32-42b1-49eb-85de-00ccac753483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:58 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-eb6e44c0-9fa1-4a28-a983-9a33f3e88fe7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Created volume successfully. Sep 25 17:16:58 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0 1073741824" returned: 0 in 0.526s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:58 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0 Sep 25 17:16:58 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:59 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0" returned: 0 in 0.268s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:59 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:16:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-1c59d84b-e929-47d6-b6a7-71f771715f72 req-3fdb8def-aa17-465e-b5fc-778fbdcc6dd5 tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.187s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934d26bc-630a-46b0-a795-34ab4c2162e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd915d1c-5716-4038-9609-439b544b093f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-1c59d84b-e929-47d6-b6a7-71f771715f72 req-3fdb8def-aa17-465e-b5fc-778fbdcc6dd5 tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:59 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Volume volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0 (4a2f6a6a-61b5-4a58-9789-c797cc0055b0): created successfully Sep 25 17:16:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd915d1c-5716-4038-9609-439b544b093f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Flow 'volume_create_manager' (574371a6-72b1-4bdb-917f-150be10e3ff0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:59 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-f2fbcd0d-ca8d-486b-b22e-d2417b777698 tempest-VolumesSnapshotTestJSON-2017449264 None] Created volume successfully. Sep 25 17:16:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-1c59d84b-e929-47d6-b6a7-71f771715f72 req-3fdb8def-aa17-465e-b5fc-778fbdcc6dd5 tempest-AttachVolumeNegativeTest-878525210 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-baca0f8e-f1ad-4703-8d06-631f3dda3cc2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25d14a26-5da8-40a7-9b37-6f82bccb569e', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:16:59 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-1c59d84b-e929-47d6-b6a7-71f771715f72 req-3fdb8def-aa17-465e-b5fc-778fbdcc6dd5 tempest-AttachVolumeNegativeTest-878525210 None] attachment_update completed successfully. Sep 25 17:17:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-c800477e-b30c-405c-a136-dbc27614ac56 req-d483b29c-911d-400d-a530-cbba6a448335 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-c800477e-b30c-405c-a136-dbc27614ac56 req-d483b29c-911d-400d-a530-cbba6a448335 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-c800477e-b30c-405c-a136-dbc27614ac56 req-d483b29c-911d-400d-a530-cbba6a448335 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:00 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-c800477e-b30c-405c-a136-dbc27614ac56 req-d483b29c-911d-400d-a530-cbba6a448335 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-1f6e7266-8b45-4737-a1c3-d5e6d812638f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf338c4c-5e95-495d-bb5b-2d060c914d7b', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:17:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c6df04f8-41a4-4189-8965-c72506503917 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c6df04f8-41a4-4189-8965-c72506503917 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:00 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-c6df04f8-41a4-4189-8965-c72506503917 tempest-VolumesSnapshotTestJSON-2017449264 None] Creating offline snapshot 44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1 of volume 4a2f6a6a-61b5-4a58-9789-c797cc0055b0 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:17:00 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-c800477e-b30c-405c-a136-dbc27614ac56 req-d483b29c-911d-400d-a530-cbba6a448335 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] attachment_update completed successfully. Sep 25 17:17:00 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cca7d0-2bee-4dc5-9c0d-000adb370c47]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c6df04f8-41a4-4189-8965-c72506503917 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:00 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0 Sep 25 17:17:00 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:01 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c6df04f8-41a4-4189-8965-c72506503917 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0" returned: 0 in 0.462s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c6df04f8-41a4-4189-8965-c72506503917 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:01 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1 1G Sep 25 17:17:01 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:01 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c6df04f8-41a4-4189-8965-c72506503917 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1 1G" returned: 0 in 0.730s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c6df04f8-41a4-4189-8965-c72506503917 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:02 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1 Sep 25 17:17:02 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:02 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c6df04f8-41a4-4189-8965-c72506503917 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1" returned: 0 in 0.426s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:02 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-c6df04f8-41a4-4189-8965-c72506503917 tempest-VolumesSnapshotTestJSON-2017449264 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1 is being set with open permissions: ugo+rw Sep 25 17:17:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c6df04f8-41a4-4189-8965-c72506503917 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:02 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1 Sep 25 17:17:02 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:02 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-6867b244-dd6e-4f97-bd0a-2c44dc2d5740 req-43959ab4-52ae-4733-bc45-5e399779f830 tempest-AttachVolumeNegativeTest-878525210 None] Terminate volume connection completed successfully. Sep 25 17:17:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-6867b244-dd6e-4f97-bd0a-2c44dc2d5740 req-43959ab4-52ae-4733-bc45-5e399779f830 tempest-AttachVolumeNegativeTest-878525210 None] Deleting attachment 25d14a26-5da8-40a7-9b37-6f82bccb569e. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:17:02 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c6df04f8-41a4-4189-8965-c72506503917 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1" returned: 0 in 0.420s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c6df04f8-41a4-4189-8965-c72506503917 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:02 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.info Sep 25 17:17:02 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:03 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c6df04f8-41a4-4189-8965-c72506503917 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.info" returned: 0 in 0.343s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:03 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-c6df04f8-41a4-4189-8965-c72506503917 tempest-VolumesSnapshotTestJSON-2017449264 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.info is being set with open permissions: ugo+rw Sep 25 17:17:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c6df04f8-41a4-4189-8965-c72506503917 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:03 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.info Sep 25 17:17:03 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:03 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c6df04f8-41a4-4189-8965-c72506503917 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.info" returned: 0 in 0.406s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c6df04f8-41a4-4189-8965-c72506503917 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.948s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:03 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-c6df04f8-41a4-4189-8965-c72506503917 tempest-VolumesSnapshotTestJSON-2017449264 None] Create snapshot completed successfully Sep 25 17:17:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-356b6077-279b-4bec-bfea-a7f5103f71ea tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-356b6077-279b-4bec-bfea-a7f5103f71ea tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-356b6077-279b-4bec-bfea-a7f5103f71ea tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-quobyte-4a2f6a6a-61b5-4a58-9789-c797cc0055b0" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-356b6077-279b-4bec-bfea-a7f5103f71ea tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-4a2f6a6a-61b5-4a58-9789-c797cc0055b0" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-356b6077-279b-4bec-bfea-a7f5103f71ea tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-quobyte-44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-356b6077-279b-4bec-bfea-a7f5103f71ea tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:04 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-356b6077-279b-4bec-bfea-a7f5103f71ea tempest-VolumesSnapshotTestJSON-2017449264 None] Deleting offline snapshot 44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1 of volume 4a2f6a6a-61b5-4a58-9789-c797cc0055b0 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:17:04 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-356b6077-279b-4bec-bfea-a7f5103f71ea tempest-VolumesSnapshotTestJSON-2017449264 None] snapshot_file for this snap is: volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:17:04 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[339e8440-cb40-47f4-ac87-36f7bc617572]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-356b6077-279b-4bec-bfea-a7f5103f71ea tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:04 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1 Sep 25 17:17:04 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:04 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-b698a187-c0d5-4ca9-9595-bb054dc871a3 req-71711f78-c674-4d38-ba8e-9411322109b7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Terminate volume connection completed successfully. Sep 25 17:17:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-b698a187-c0d5-4ca9-9595-bb054dc871a3 req-71711f78-c674-4d38-ba8e-9411322109b7 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Deleting attachment bf338c4c-5e95-495d-bb5b-2d060c914d7b. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:17:05 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-356b6077-279b-4bec-bfea-a7f5103f71ea tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1" returned: 0 in 0.528s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-356b6077-279b-4bec-bfea-a7f5103f71ea tempest-VolumesSnapshotTestJSON-2017449264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:17:05 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[027cf07a-700c-45a0-be90-c722702ee076]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-356b6077-279b-4bec-bfea-a7f5103f71ea tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:05 devstack sudo[101722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0 Sep 25 17:17:05 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:05 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5b491b09-f12c-4444-82f4-3c422fb958b4 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Acquiring lock "cinder-1f6e7266-8b45-4737-a1c3-d5e6d812638f-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:05 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5b491b09-f12c-4444-82f4-3c422fb958b4 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Lock "cinder-1f6e7266-8b45-4737-a1c3-d5e6d812638f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:05 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5b491b09-f12c-4444-82f4-3c422fb958b4 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Acquiring lock "cinder-quobyte-1f6e7266-8b45-4737-a1c3-d5e6d812638f" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:05 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5b491b09-f12c-4444-82f4-3c422fb958b4 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Lock "cinder-quobyte-1f6e7266-8b45-4737-a1c3-d5e6d812638f" acquired by "delete_volume" :: waited 0.033s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:05 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-356b6077-279b-4bec-bfea-a7f5103f71ea tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0" returned: 0 in 0.603s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-356b6077-279b-4bec-bfea-a7f5103f71ea tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:05 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9182e924-9757-4d86-875b-42bb764e0832]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5b491b09-f12c-4444-82f4-3c422fb958b4 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1f6e7266-8b45-4737-a1c3-d5e6d812638f {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:05 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1 Sep 25 17:17:05 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:05 devstack sudo[101730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1f6e7266-8b45-4737-a1c3-d5e6d812638f Sep 25 17:17:05 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:06 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-356b6077-279b-4bec-bfea-a7f5103f71ea tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1" returned: 0 in 0.434s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-356b6077-279b-4bec-bfea-a7f5103f71ea tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:06 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1 Sep 25 17:17:06 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:06 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5b491b09-f12c-4444-82f4-3c422fb958b4 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1f6e7266-8b45-4737-a1c3-d5e6d812638f" returned: 0 in 0.465s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5b491b09-f12c-4444-82f4-3c422fb958b4 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1f6e7266-8b45-4737-a1c3-d5e6d812638f {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:06 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1f6e7266-8b45-4737-a1c3-d5e6d812638f Sep 25 17:17:06 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:06 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-356b6077-279b-4bec-bfea-a7f5103f71ea tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0.44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1" returned: 0 in 0.343s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:06 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-356b6077-279b-4bec-bfea-a7f5103f71ea tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1" released by "_delete_snapshot" :: held 2.087s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:06 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-356b6077-279b-4bec-bfea-a7f5103f71ea tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-4a2f6a6a-61b5-4a58-9789-c797cc0055b0" released by "delete_snapshot" :: held 2.119s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:06 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5b491b09-f12c-4444-82f4-3c422fb958b4 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1f6e7266-8b45-4737-a1c3-d5e6d812638f" returned: 0 in 0.417s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:06 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5b491b09-f12c-4444-82f4-3c422fb958b4 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Lock "cinder-quobyte-1f6e7266-8b45-4737-a1c3-d5e6d812638f" released by "delete_volume" :: held 0.942s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:06 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-356b6077-279b-4bec-bfea-a7f5103f71ea tempest-VolumesSnapshotTestJSON-2017449264 None] Created reservations ['c941b8cb-25ad-4a77-8d6a-d016ceb39ebf', '84a317bd-7852-4b6c-9ac6-e699eea2f2ec', '02431b2f-46b9-4d23-9c99-a473e90b69bc', '1262be8d-d288-4a16-a60c-4a3d334e740a'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:17:06 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-5b491b09-f12c-4444-82f4-3c422fb958b4 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Created reservations ['5e5052a6-3759-4784-ba79-6a8114ed2ffa', '13920f9c-a8ce-47dd-8a46-f8fb9af91d19', 'c3a92e21-6d82-4b95-a2c7-ae29091be118', '1c410330-3477-458b-b053-48ba9469b60b'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:17:06 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-356b6077-279b-4bec-bfea-a7f5103f71ea tempest-VolumesSnapshotTestJSON-2017449264 None] Delete snapshot completed successfully. Sep 25 17:17:06 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-356b6077-279b-4bec-bfea-a7f5103f71ea tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-44cc5fd0-bf0c-4478-9d3f-fa888c8eaca1-delete_snapshot" released by "delete_snapshot" :: held 2.578s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5b491b09-f12c-4444-82f4-3c422fb958b4 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5b491b09-f12c-4444-82f4-3c422fb958b4 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5b491b09-f12c-4444-82f4-3c422fb958b4 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5b491b09-f12c-4444-82f4-3c422fb958b4 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5b491b09-f12c-4444-82f4-3c422fb958b4 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5b491b09-f12c-4444-82f4-3c422fb958b4 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:06 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:17:06 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:07 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5b491b09-f12c-4444-82f4-3c422fb958b4 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.369s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:07 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-5b491b09-f12c-4444-82f4-3c422fb958b4 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:17:07 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-5b491b09-f12c-4444-82f4-3c422fb958b4 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Deleted volume successfully. Sep 25 17:17:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5b491b09-f12c-4444-82f4-3c422fb958b4 tempest-TestServerVolumeAttachScenarioOldVersion-1626295515 None] Lock "cinder-1f6e7266-8b45-4737-a1c3-d5e6d812638f-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:08 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:17:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Flow 'volume_create_manager' (1c40be57-3209-46be-b47e-29d1424ce4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47665d2c-41f2-4bc8-845d-4915374a9fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47665d2c-41f2-4bc8-845d-4915374a9fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-721617337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee5af0f-9be8-4e17-a564-0a1ad90fe95e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a82bf8562e4e2ba28ecacf47768e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:17:08Z,use_quota=True,user_id='d4ca2f2108224c768340557a1c6d2516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a335c71a-93c6-47ca-97a2-0bdbf7d65db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a335c71a-93c6-47ca-97a2-0bdbf7d65db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd04179e-52c5-4e7b-9a68-05c9e97429e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd04179e-52c5-4e7b-9a68-05c9e97429e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ee5af0f-9be8-4e17-a564-0a1ad90fe95e', 'volume_name': 'volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce434d2e-e7d2-4beb-8f86-dc67ceec9555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce434d2e-e7d2-4beb-8f86-dc67ceec9555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66170f74-bbe7-4cdd-a87b-ce0d0883b89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:08 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Volume 0ee5af0f-9be8-4e17-a564-0a1ad90fe95e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e', 'volume_size': 1} Sep 25 17:17:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-721617337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee5af0f-9be8-4e17-a564-0a1ad90fe95e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a82bf8562e4e2ba28ecacf47768e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:17:08Z,use_quota=True,user_id='d4ca2f2108224c768340557a1c6d2516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:17:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Creating volume 0ee5af0f-9be8-4e17-a564-0a1ad90fe95e {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:17:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:17:08 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:17:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:08 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e 1073741824 Sep 25 17:17:08 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:09 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e 1073741824" returned: 0 in 0.619s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:09 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e Sep 25 17:17:09 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:09 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e" returned: 0 in 0.337s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:09 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:17:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66170f74-bbe7-4cdd-a87b-ce0d0883b89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37af08be-5137-4967-984f-c258448aca46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:09 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Volume volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e (0ee5af0f-9be8-4e17-a564-0a1ad90fe95e): created successfully Sep 25 17:17:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37af08be-5137-4967-984f-c258448aca46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Flow 'volume_create_manager' (1c40be57-3209-46be-b47e-29d1424ce4fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:09 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-88df9898-cc7e-4610-8068-70d6dad86a22 tempest-VolumesSnapshotTestJSON-2017449264 None] Created volume successfully. Sep 25 17:17:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bac7e832-d252-4c28-ac78-285a365b6bb2 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bac7e832-d252-4c28-ac78-285a365b6bb2 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-bac7e832-d252-4c28-ac78-285a365b6bb2 tempest-VolumesSnapshotTestJSON-2017449264 None] Creating offline snapshot 976db3c3-4f2e-4632-babe-84e04bf2ae16 of volume 0ee5af0f-9be8-4e17-a564-0a1ad90fe95e {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:17:10 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c44c0e6-40f8-40e2-96af-1dc56757721a]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bac7e832-d252-4c28-ac78-285a365b6bb2 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:10 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e Sep 25 17:17:10 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:11 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bac7e832-d252-4c28-ac78-285a365b6bb2 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e" returned: 0 in 0.481s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bac7e832-d252-4c28-ac78-285a365b6bb2 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:11 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16 1G Sep 25 17:17:11 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:11 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bac7e832-d252-4c28-ac78-285a365b6bb2 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16 1G" returned: 0 in 0.597s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bac7e832-d252-4c28-ac78-285a365b6bb2 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:11 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16 Sep 25 17:17:11 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:12 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bac7e832-d252-4c28-ac78-285a365b6bb2 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16" returned: 0 in 0.489s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:12 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-bac7e832-d252-4c28-ac78-285a365b6bb2 tempest-VolumesSnapshotTestJSON-2017449264 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16 is being set with open permissions: ugo+rw Sep 25 17:17:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bac7e832-d252-4c28-ac78-285a365b6bb2 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:12 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16 Sep 25 17:17:12 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:12 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bac7e832-d252-4c28-ac78-285a365b6bb2 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16" returned: 0 in 0.317s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bac7e832-d252-4c28-ac78-285a365b6bb2 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:12 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.info Sep 25 17:17:12 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:13 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bac7e832-d252-4c28-ac78-285a365b6bb2 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.info" returned: 0 in 0.362s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:13 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-bac7e832-d252-4c28-ac78-285a365b6bb2 tempest-VolumesSnapshotTestJSON-2017449264 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.info is being set with open permissions: ugo+rw Sep 25 17:17:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bac7e832-d252-4c28-ac78-285a365b6bb2 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:13 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.info Sep 25 17:17:13 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:13 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bac7e832-d252-4c28-ac78-285a365b6bb2 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.info" returned: 0 in 0.422s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bac7e832-d252-4c28-ac78-285a365b6bb2 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.801s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:13 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-bac7e832-d252-4c28-ac78-285a365b6bb2 tempest-VolumesSnapshotTestJSON-2017449264 None] Create snapshot completed successfully Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:UPDATE=82,cinder:SELECT=90,cinder:INSERT=21,cinder:DELETE=8 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=97,cinder:UPDATE=88,cinder:INSERT=16,cinder:DELETE=7 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Flow 'volume_create_manager' (86774eb8-c9f3-4538-bb9a-fc9e01cc10c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff64e86-f96a-4b02-b235-aba53c84e86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff64e86-f96a-4b02-b235-aba53c84e86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1109362482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a82685-9656-44b9-88e5-12f405081fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a82bf8562e4e2ba28ecacf47768e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:17:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=976db3c3-4f2e-4632-babe-84e04bf2ae16,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:17:15Z,use_quota=True,user_id='d4ca2f2108224c768340557a1c6d2516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb0a60e9-01fd-486f-ae57-a9b43456c39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb0a60e9-01fd-486f-ae57-a9b43456c39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97de7bd0-34eb-4416-bf46-67aafe9ecae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97de7bd0-34eb-4416-bf46-67aafe9ecae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '87a82685-9656-44b9-88e5-12f405081fc5', 'volume_name': 'volume-87a82685-9656-44b9-88e5-12f405081fc5', 'volume_size': 2, 'snapshot_id': '976db3c3-4f2e-4632-babe-84e04bf2ae16'}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac7852a-3306-4b3f-971d-2146aba25b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac7852a-3306-4b3f-971d-2146aba25b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889ed5fd-2ac4-4d0e-9cb1-3e5da1e75c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:14 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Volume 87a82685-9656-44b9-88e5-12f405081fc5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-87a82685-9656-44b9-88e5-12f405081fc5', 'volume_size': 2, 'snapshot_id': '976db3c3-4f2e-4632-babe-84e04bf2ae16'} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-quobyte-976db3c3-4f2e-4632-babe-84e04bf2ae16-87a82685-9656-44b9-88e5-12f405081fc5" by "_create_volume_from_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-976db3c3-4f2e-4632-babe-84e04bf2ae16-87a82685-9656-44b9-88e5-12f405081fc5" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Creating volume 87a82685-9656-44b9-88e5-12f405081fc5 from snapshot 976db3c3-4f2e-4632-babe-84e04bf2ae16 {{(pid=87211) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-quobyte-87a82685-9656-44b9-88e5-12f405081fc5" by "_copy_volume_from_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-87a82685-9656-44b9-88e5-12f405081fc5" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] snapshot: 976db3c3-4f2e-4632-babe-84e04bf2ae16, volume: 87a82685-9656-44b9-88e5-12f405081fc5, {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd200597-c14b-4d86-b21b-d1a76aae5c66]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:15 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16 Sep 25 17:17:15 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:15 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16" returned: 0 in 0.482s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:17:15 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d2b023-6734-426f-9910-fdaf7c9787ce]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:15 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e Sep 25 17:17:15 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:15 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e" returned: 0 in 0.430s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] will copy from snapshot at /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:17:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Creating direct copy from snapshot {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:17:15 devstack cinder-volume[87211]: DEBUG cinder.utils [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Path /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-87a82685-9656-44b9-88e5-12f405081fc5 not found in is_blk_device check {{(pid=87211) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:17:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-87a82685-9656-44b9-88e5-12f405081fc5 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:15 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-87a82685-9656-44b9-88e5-12f405081fc5 Sep 25 17:17:15 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:23 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-87a82685-9656-44b9-88e5-12f405081fc5" returned: 0 in 8.061s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:23 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Image conversion details: src /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e, size 1024.00 MB, duration 8.06 sec, destination /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-87a82685-9656-44b9-88e5-12f405081fc5 {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:17:23 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Converted 1024.00 MB image at 127.01 MB/s Sep 25 17:17:23 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-87a82685-9656-44b9-88e5-12f405081fc5 is being set with open permissions: ugo+rw Sep 25 17:17:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-87a82685-9656-44b9-88e5-12f405081fc5 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:23 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-87a82685-9656-44b9-88e5-12f405081fc5 Sep 25 17:17:23 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:24 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-87a82685-9656-44b9-88e5-12f405081fc5" returned: 0 in 0.285s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-87a82685-9656-44b9-88e5-12f405081fc5" released by "_copy_volume_from_snapshot" :: held 9.364s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-976db3c3-4f2e-4632-babe-84e04bf2ae16-87a82685-9656-44b9-88e5-12f405081fc5" released by "_create_volume_from_snapshot" :: held 9.434s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.452s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889ed5fd-2ac4-4d0e-9cb1-3e5da1e75c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87a82685-9656-44b9-88e5-12f405081fc5', 'volume_size': 2, 'snapshot_id': '976db3c3-4f2e-4632-babe-84e04bf2ae16'}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197ac76a-edf3-4a12-b3ba-3e564727c559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:24 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Volume volume-87a82685-9656-44b9-88e5-12f405081fc5 (87a82685-9656-44b9-88e5-12f405081fc5): created successfully Sep 25 17:17:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197ac76a-edf3-4a12-b3ba-3e564727c559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Flow 'volume_create_manager' (86774eb8-c9f3-4538-bb9a-fc9e01cc10c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:24 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-414512fe-a2d3-4811-9f9c-49ea21708088 tempest-VolumesSnapshotTestJSON-2017449264 None] Created volume successfully. Sep 25 17:17:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0f393f2a-9dd0-49e6-ae3e-9bef2e72d3ae tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-87a82685-9656-44b9-88e5-12f405081fc5-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0f393f2a-9dd0-49e6-ae3e-9bef2e72d3ae tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-87a82685-9656-44b9-88e5-12f405081fc5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0f393f2a-9dd0-49e6-ae3e-9bef2e72d3ae tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-quobyte-87a82685-9656-44b9-88e5-12f405081fc5" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0f393f2a-9dd0-49e6-ae3e-9bef2e72d3ae tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-87a82685-9656-44b9-88e5-12f405081fc5" acquired by "delete_volume" :: waited 0.015s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:25 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ba4267-8c79-411c-8e14-8b6661d8fa69]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0f393f2a-9dd0-49e6-ae3e-9bef2e72d3ae tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-87a82685-9656-44b9-88e5-12f405081fc5 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:25 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-87a82685-9656-44b9-88e5-12f405081fc5 Sep 25 17:17:25 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:25 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0f393f2a-9dd0-49e6-ae3e-9bef2e72d3ae tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-87a82685-9656-44b9-88e5-12f405081fc5" returned: 0 in 0.438s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0f393f2a-9dd0-49e6-ae3e-9bef2e72d3ae tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-87a82685-9656-44b9-88e5-12f405081fc5 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:25 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-87a82685-9656-44b9-88e5-12f405081fc5 Sep 25 17:17:25 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:25 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0f393f2a-9dd0-49e6-ae3e-9bef2e72d3ae tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-87a82685-9656-44b9-88e5-12f405081fc5" returned: 0 in 0.268s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0f393f2a-9dd0-49e6-ae3e-9bef2e72d3ae tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-87a82685-9656-44b9-88e5-12f405081fc5" released by "delete_volume" :: held 0.777s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:25 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-0f393f2a-9dd0-49e6-ae3e-9bef2e72d3ae tempest-VolumesSnapshotTestJSON-2017449264 None] Created reservations ['1ebc483d-bbd1-4946-b8a5-329e1134450a', 'ed9504a4-994c-48b2-a876-2576c0ba3591', '92580e66-a384-4097-9da5-f126003f9ed2', '425aa126-61f4-4c8e-8e48-a62a8af69ac2'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:17:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0f393f2a-9dd0-49e6-ae3e-9bef2e72d3ae tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0f393f2a-9dd0-49e6-ae3e-9bef2e72d3ae tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0f393f2a-9dd0-49e6-ae3e-9bef2e72d3ae tempest-VolumesSnapshotTestJSON-2017449264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0f393f2a-9dd0-49e6-ae3e-9bef2e72d3ae tempest-VolumesSnapshotTestJSON-2017449264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0f393f2a-9dd0-49e6-ae3e-9bef2e72d3ae tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0f393f2a-9dd0-49e6-ae3e-9bef2e72d3ae tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:26 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:17:26 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:26 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2f77113b-ad67-4b81-acbe-1e522197bfaa tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-976db3c3-4f2e-4632-babe-84e04bf2ae16-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:26 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2f77113b-ad67-4b81-acbe-1e522197bfaa tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-976db3c3-4f2e-4632-babe-84e04bf2ae16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.080s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:26 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2f77113b-ad67-4b81-acbe-1e522197bfaa tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-quobyte-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:26 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0f393f2a-9dd0-49e6-ae3e-9bef2e72d3ae tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.430s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:26 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-0f393f2a-9dd0-49e6-ae3e-9bef2e72d3ae tempest-VolumesSnapshotTestJSON-2017449264 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:17:26 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2f77113b-ad67-4b81-acbe-1e522197bfaa tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:26 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2f77113b-ad67-4b81-acbe-1e522197bfaa tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-quobyte-976db3c3-4f2e-4632-babe-84e04bf2ae16" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:26 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-0f393f2a-9dd0-49e6-ae3e-9bef2e72d3ae tempest-VolumesSnapshotTestJSON-2017449264 None] Deleted volume successfully. Sep 25 17:17:26 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2f77113b-ad67-4b81-acbe-1e522197bfaa tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-976db3c3-4f2e-4632-babe-84e04bf2ae16" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-2f77113b-ad67-4b81-acbe-1e522197bfaa tempest-VolumesSnapshotTestJSON-2017449264 None] Deleting offline snapshot 976db3c3-4f2e-4632-babe-84e04bf2ae16 of volume 0ee5af0f-9be8-4e17-a564-0a1ad90fe95e {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:17:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-2f77113b-ad67-4b81-acbe-1e522197bfaa tempest-VolumesSnapshotTestJSON-2017449264 None] snapshot_file for this snap is: volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:17:26 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0f393f2a-9dd0-49e6-ae3e-9bef2e72d3ae tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-87a82685-9656-44b9-88e5-12f405081fc5-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:26 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0408103-1b9d-4623-980a-c4f2df54c6eb]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2f77113b-ad67-4b81-acbe-1e522197bfaa tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:26 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16 Sep 25 17:17:26 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:26 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2f77113b-ad67-4b81-acbe-1e522197bfaa tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16" returned: 0 in 0.418s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-2f77113b-ad67-4b81-acbe-1e522197bfaa tempest-VolumesSnapshotTestJSON-2017449264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:17:27 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[839a887a-f654-4018-a6a3-25e75710c2e1]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2f77113b-ad67-4b81-acbe-1e522197bfaa tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:27 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e Sep 25 17:17:27 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:27 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2f77113b-ad67-4b81-acbe-1e522197bfaa tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e" returned: 0 in 0.570s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2f77113b-ad67-4b81-acbe-1e522197bfaa tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:27 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16 Sep 25 17:17:27 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:28 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2f77113b-ad67-4b81-acbe-1e522197bfaa tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16" returned: 0 in 0.419s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2f77113b-ad67-4b81-acbe-1e522197bfaa tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:28 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16 Sep 25 17:17:28 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:28 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2f77113b-ad67-4b81-acbe-1e522197bfaa tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e.976db3c3-4f2e-4632-babe-84e04bf2ae16" returned: 0 in 0.315s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2f77113b-ad67-4b81-acbe-1e522197bfaa tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-976db3c3-4f2e-4632-babe-84e04bf2ae16" released by "_delete_snapshot" :: held 1.872s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2f77113b-ad67-4b81-acbe-1e522197bfaa tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e" released by "delete_snapshot" :: held 1.917s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:28 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-2f77113b-ad67-4b81-acbe-1e522197bfaa tempest-VolumesSnapshotTestJSON-2017449264 None] Created reservations ['75a691b2-66dc-4c00-a837-9de94ff1ce9d', 'f8d6224e-823f-436c-8370-d6e3f478894d', 'f50b246b-822f-4736-8780-61d11b9626e0', '99b3b07b-6230-4d73-924e-4ae6bdd5964c'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:17:28 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-2f77113b-ad67-4b81-acbe-1e522197bfaa tempest-VolumesSnapshotTestJSON-2017449264 None] Delete snapshot completed successfully. Sep 25 17:17:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2f77113b-ad67-4b81-acbe-1e522197bfaa tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-976db3c3-4f2e-4632-babe-84e04bf2ae16-delete_snapshot" released by "delete_snapshot" :: held 2.110s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-94a1da28-eefb-4e9b-8f34-b84bf1626133 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-94a1da28-eefb-4e9b-8f34-b84bf1626133 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-94a1da28-eefb-4e9b-8f34-b84bf1626133 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-quobyte-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-94a1da28-eefb-4e9b-8f34-b84bf1626133 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e" acquired by "delete_volume" :: waited 0.032s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:29 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6b4c27-5f1f-4a4e-8a11-93be93d69242]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-94a1da28-eefb-4e9b-8f34-b84bf1626133 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:29 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e Sep 25 17:17:29 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:29 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-94a1da28-eefb-4e9b-8f34-b84bf1626133 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e" returned: 0 in 0.539s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-94a1da28-eefb-4e9b-8f34-b84bf1626133 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:29 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e Sep 25 17:17:29 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:29 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-94a1da28-eefb-4e9b-8f34-b84bf1626133 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e" returned: 0 in 0.379s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-94a1da28-eefb-4e9b-8f34-b84bf1626133 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e" released by "delete_volume" :: held 1.050s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:30 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-94a1da28-eefb-4e9b-8f34-b84bf1626133 tempest-VolumesSnapshotTestJSON-2017449264 None] Created reservations ['ffec59cd-1819-462f-9b12-54768309a1e2', '98210ae7-d07c-42e8-9c2c-1092f59fcb5c', '5a7c1a24-f5f6-47c6-962d-fac4cf7a9c07', '671a20ae-28e4-4052-8013-f03ad5180f49'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:17:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-94a1da28-eefb-4e9b-8f34-b84bf1626133 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-94a1da28-eefb-4e9b-8f34-b84bf1626133 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-94a1da28-eefb-4e9b-8f34-b84bf1626133 tempest-VolumesSnapshotTestJSON-2017449264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-94a1da28-eefb-4e9b-8f34-b84bf1626133 tempest-VolumesSnapshotTestJSON-2017449264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-94a1da28-eefb-4e9b-8f34-b84bf1626133 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-94a1da28-eefb-4e9b-8f34-b84bf1626133 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:30 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:17:30 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:30 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-94a1da28-eefb-4e9b-8f34-b84bf1626133 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.321s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:30 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-94a1da28-eefb-4e9b-8f34-b84bf1626133 tempest-VolumesSnapshotTestJSON-2017449264 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:17:30 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-94a1da28-eefb-4e9b-8f34-b84bf1626133 tempest-VolumesSnapshotTestJSON-2017449264 None] Deleted volume successfully. Sep 25 17:17:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-94a1da28-eefb-4e9b-8f34-b84bf1626133 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-0ee5af0f-9be8-4e17-a564-0a1ad90fe95e-delete_volume" released by "delete_volume" :: held 1.934s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Flow 'volume_create_manager' (70d691bb-5051-44f3-9aec-84cd1a809ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f96399b4-0168-4cec-90b5-117c613a3d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f96399b4-0168-4cec-90b5-117c613a3d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1542914498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f097b589-d95a-4c94-b5c0-9b9b86b7d5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a82bf8562e4e2ba28ecacf47768e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:17:32Z,use_quota=True,user_id='d4ca2f2108224c768340557a1c6d2516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7b19cd-42f1-400b-a2ff-ae441e9e7701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7b19cd-42f1-400b-a2ff-ae441e9e7701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd234e07-9b0c-4fb8-acf3-4afb0d61de73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd234e07-9b0c-4fb8-acf3-4afb0d61de73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f097b589-d95a-4c94-b5c0-9b9b86b7d5de', 'volume_name': 'volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a833ced-f228-4693-878c-077c2d54cfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a833ced-f228-4693-878c-077c2d54cfbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96919ab5-edf0-43eb-98cf-5e632cb8d6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:32 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Volume f097b589-d95a-4c94-b5c0-9b9b86b7d5de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de', 'volume_size': 1} Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1542914498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f097b589-d95a-4c94-b5c0-9b9b86b7d5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a82bf8562e4e2ba28ecacf47768e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:17:32Z,use_quota=True,user_id='d4ca2f2108224c768340557a1c6d2516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Creating volume f097b589-d95a-4c94-b5c0-9b9b86b7d5de {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:17:32 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:32 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de 1073741824 Sep 25 17:17:32 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:32 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de 1073741824" returned: 0 in 0.659s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:32 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de Sep 25 17:17:32 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:33 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de" returned: 0 in 0.352s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:17:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96919ab5-edf0-43eb-98cf-5e632cb8d6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9d8104-581b-44bf-9563-0519e26b9ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:33 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Volume volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de (f097b589-d95a-4c94-b5c0-9b9b86b7d5de): created successfully Sep 25 17:17:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9d8104-581b-44bf-9563-0519e26b9ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Flow 'volume_create_manager' (70d691bb-5051-44f3-9aec-84cd1a809ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:33 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b711e9e3-f5dd-4893-b214-7437537d1de2 tempest-VolumesSnapshotTestJSON-2017449264 None] Created volume successfully. Sep 25 17:17:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-334ee24e-982e-475c-8f54-c5edbc378fdb tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-334ee24e-982e-475c-8f54-c5edbc378fdb tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-334ee24e-982e-475c-8f54-c5edbc378fdb tempest-VolumesSnapshotTestJSON-2017449264 None] Creating offline snapshot 4b18736a-7e53-4bcb-9944-531284d4110c of volume f097b589-d95a-4c94-b5c0-9b9b86b7d5de {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:17:34 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1206c48-58ec-41b4-98f6-9a9a9570b362]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-334ee24e-982e-475c-8f54-c5edbc378fdb tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:34 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de Sep 25 17:17:34 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:34 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-334ee24e-982e-475c-8f54-c5edbc378fdb tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de" returned: 0 in 0.476s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-334ee24e-982e-475c-8f54-c5edbc378fdb tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:34 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c 1G Sep 25 17:17:34 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:35 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-334ee24e-982e-475c-8f54-c5edbc378fdb tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c 1G" returned: 0 in 0.553s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-334ee24e-982e-475c-8f54-c5edbc378fdb tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:35 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c Sep 25 17:17:35 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:35 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-334ee24e-982e-475c-8f54-c5edbc378fdb tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c" returned: 0 in 0.464s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:35 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-334ee24e-982e-475c-8f54-c5edbc378fdb tempest-VolumesSnapshotTestJSON-2017449264 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c is being set with open permissions: ugo+rw Sep 25 17:17:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-334ee24e-982e-475c-8f54-c5edbc378fdb tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:35 devstack sudo[101935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c Sep 25 17:17:35 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:36 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-334ee24e-982e-475c-8f54-c5edbc378fdb tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c" returned: 0 in 0.413s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-334ee24e-982e-475c-8f54-c5edbc378fdb tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:36 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.info Sep 25 17:17:36 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:37 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-334ee24e-982e-475c-8f54-c5edbc378fdb tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.info" returned: 0 in 0.823s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:37 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-334ee24e-982e-475c-8f54-c5edbc378fdb tempest-VolumesSnapshotTestJSON-2017449264 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.info is being set with open permissions: ugo+rw Sep 25 17:17:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-334ee24e-982e-475c-8f54-c5edbc378fdb tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:37 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.info Sep 25 17:17:37 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:37 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-334ee24e-982e-475c-8f54-c5edbc378fdb tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.info" returned: 0 in 0.625s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-334ee24e-982e-475c-8f54-c5edbc378fdb tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.559s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:37 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-334ee24e-982e-475c-8f54-c5edbc378fdb tempest-VolumesSnapshotTestJSON-2017449264 None] Create snapshot completed successfully Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Flow 'volume_create_manager' (d0a34773-1363-4f4b-a587-8f82dcaeba16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (380bd3dd-c9e0-4315-8bb9-13639fa033b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (380bd3dd-c9e0-4315-8bb9-13639fa033b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-599486627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6b5d959-1a1b-45f6-81df-d8af78aa4f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a82bf8562e4e2ba28ecacf47768e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4b18736a-7e53-4bcb-9944-531284d4110c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:17:39Z,use_quota=True,user_id='d4ca2f2108224c768340557a1c6d2516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e1de0a2-3fd4-4b4d-b49a-f10f2ae3bc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e1de0a2-3fd4-4b4d-b49a-f10f2ae3bc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a3a2b0-b5b8-4e6e-a215-b5ed4c074237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a3a2b0-b5b8-4e6e-a215-b5ed4c074237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e6b5d959-1a1b-45f6-81df-d8af78aa4f50', 'volume_name': 'volume-e6b5d959-1a1b-45f6-81df-d8af78aa4f50', 'volume_size': 1, 'snapshot_id': '4b18736a-7e53-4bcb-9944-531284d4110c'}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee16110-0add-4daf-8b0e-35224428940e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee16110-0add-4daf-8b0e-35224428940e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ac77be-9434-4eaa-95be-4ecb26a23283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:39 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Volume e6b5d959-1a1b-45f6-81df-d8af78aa4f50: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e6b5d959-1a1b-45f6-81df-d8af78aa4f50', 'volume_size': 1, 'snapshot_id': '4b18736a-7e53-4bcb-9944-531284d4110c'} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-quobyte-4b18736a-7e53-4bcb-9944-531284d4110c-e6b5d959-1a1b-45f6-81df-d8af78aa4f50" by "_create_volume_from_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-4b18736a-7e53-4bcb-9944-531284d4110c-e6b5d959-1a1b-45f6-81df-d8af78aa4f50" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Creating volume e6b5d959-1a1b-45f6-81df-d8af78aa4f50 from snapshot 4b18736a-7e53-4bcb-9944-531284d4110c {{(pid=87211) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-quobyte-e6b5d959-1a1b-45f6-81df-d8af78aa4f50" by "_copy_volume_from_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-e6b5d959-1a1b-45f6-81df-d8af78aa4f50" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] snapshot: 4b18736a-7e53-4bcb-9944-531284d4110c, volume: e6b5d959-1a1b-45f6-81df-d8af78aa4f50, {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:17:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:40 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1e5185-f00d-4780-b02f-8b6034fce235]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:40 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c Sep 25 17:17:40 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:40 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c" returned: 0 in 0.656s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:17:40 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e241d29-04e4-4ef1-95f3-5826552a8c0a]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:41 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de Sep 25 17:17:41 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:41 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de" returned: 0 in 0.771s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] will copy from snapshot at /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:17:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Creating direct copy from snapshot {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:17:41 devstack cinder-volume[87211]: DEBUG cinder.utils [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Path /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e6b5d959-1a1b-45f6-81df-d8af78aa4f50 not found in is_blk_device check {{(pid=87211) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:17:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e6b5d959-1a1b-45f6-81df-d8af78aa4f50 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:41 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e6b5d959-1a1b-45f6-81df-d8af78aa4f50 Sep 25 17:17:41 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:44 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:17:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Flow 'volume_create_manager' (350191cf-432c-49c0-915a-3e8365b0c8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1d3d75-6f51-4d17-9151-d8e459af8de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1d3d75-6f51-4d17-9151-d8e459af8de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1823292626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43776fd-5ab3-457f-9c2f-bff450785044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0ebb6ecc144b3986d76c659c52f940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:17:45Z,use_quota=True,user_id='2e58634ed763407b861dda8605cebba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f054cb5b-2b1e-4fad-a6dd-c668e4ec87ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f054cb5b-2b1e-4fad-a6dd-c668e4ec87ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ed6444-b6ee-4d26-b2f0-16924ddeb1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:45 devstack cinder-volume[87211]: DEBUG cinder.image.glance [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Creating Keystone auth plugin from conf {{(pid=87211) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 17:17:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ed6444-b6ee-4d26-b2f0-16924ddeb1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b43776fd-5ab3-457f-9c2f-bff450785044', 'volume_name': 'volume-b43776fd-5ab3-457f-9c2f-bff450785044', 'volume_size': 1, 'image_id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'acaf9a5e9cfc4af3b32eda10c91e30fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'created_at': datetime.datetime(2026, 9, 25, 14, 58, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49e07b5-6f10-4f74-8114-6ae37ffc7aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49e07b5-6f10-4f74-8114-6ae37ffc7aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66bcd1f-b98b-4236-8718-1e2af729b881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:46 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Volume b43776fd-5ab3-457f-9c2f-bff450785044: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b43776fd-5ab3-457f-9c2f-bff450785044', 'volume_size': 1, 'image_id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'acaf9a5e9cfc4af3b32eda10c91e30fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'created_at': datetime.datetime(2026, 9, 25, 14, 58, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 17:17:46 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Trying to clone b43776fd-5ab3-457f-9c2f-bff450785044 from image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}]). {{(pid=87211) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 17:17:47 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_m0m9ax2hdevstack@QuobyteHD, size 20.69 MB, duration 1.30 sec {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 17:17:47 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Image download 20.69 MB at 15.89 MB/s Sep 25 17:17:47 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3618a2-76ad-4089-a03e-8c50984763b9]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_m0m9ax2hdevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:48 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_m0m9ax2hdevstack@QuobyteHD Sep 25 17:17:48 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:48 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_m0m9ax2hdevstack@QuobyteHD" returned: 0 in 0.954s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:48 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Temporary image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 is fetched for user 2e58634ed763407b861dda8605cebba3. {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 17:17:49 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[462ddbb3-d3ff-4825-857e-460461ae4c8f]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_m0m9ax2hdevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:49 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_m0m9ax2hdevstack@QuobyteHD Sep 25 17:17:49 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:49 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_m0m9ax2hdevstack@QuobyteHD" returned: 0 in 0.530s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:53 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e6b5d959-1a1b-45f6-81df-d8af78aa4f50" returned: 0 in 11.734s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Image conversion details: src /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de, size 1024.00 MB, duration 11.74 sec, destination /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e6b5d959-1a1b-45f6-81df-d8af78aa4f50 {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:17:53 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Converted 1024.00 MB image at 87.26 MB/s Sep 25 17:17:53 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e6b5d959-1a1b-45f6-81df-d8af78aa4f50 is being set with open permissions: ugo+rw Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e6b5d959-1a1b-45f6-81df-d8af78aa4f50 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:53 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e6b5d959-1a1b-45f6-81df-d8af78aa4f50 Sep 25 17:17:53 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:53 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e6b5d959-1a1b-45f6-81df-d8af78aa4f50" returned: 0 in 0.329s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-e6b5d959-1a1b-45f6-81df-d8af78aa4f50" released by "_copy_volume_from_snapshot" :: held 13.674s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-4b18736a-7e53-4bcb-9944-531284d4110c-e6b5d959-1a1b-45f6-81df-d8af78aa4f50" released by "_create_volume_from_snapshot" :: held 13.804s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.843s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.024s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1823292626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43776fd-5ab3-457f-9c2f-bff450785044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0ebb6ecc144b3986d76c659c52f940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:17:45Z,use_quota=True,user_id='2e58634ed763407b861dda8605cebba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Creating volume b43776fd-5ab3-457f-9c2f-bff450785044 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:17:53 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b43776fd-5ab3-457f-9c2f-bff450785044 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:53 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b43776fd-5ab3-457f-9c2f-bff450785044 1073741824 Sep 25 17:17:53 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:53 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:17:53 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ac77be-9434-4eaa-95be-4ecb26a23283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6b5d959-1a1b-45f6-81df-d8af78aa4f50', 'volume_size': 1, 'snapshot_id': '4b18736a-7e53-4bcb-9944-531284d4110c'}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8562e70-e0eb-4361-9822-344c7f88fd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:53 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Volume volume-e6b5d959-1a1b-45f6-81df-d8af78aa4f50 (e6b5d959-1a1b-45f6-81df-d8af78aa4f50): created successfully Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8562e70-e0eb-4361-9822-344c7f88fd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:53 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Flow 'volume_create_manager' (d0a34773-1363-4f4b-a587-8f82dcaeba16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:53 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b1c00d24-f86b-4030-853d-ab8ef46a5cdf tempest-VolumesSnapshotTestJSON-2017449264 None] Created volume successfully. Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1ef7a9a9-e80f-4d7c-beba-f007c3e59491 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-e6b5d959-1a1b-45f6-81df-d8af78aa4f50-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:54 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1ef7a9a9-e80f-4d7c-beba-f007c3e59491 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-e6b5d959-1a1b-45f6-81df-d8af78aa4f50-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.390s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 28 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1ef7a9a9-e80f-4d7c-beba-f007c3e59491 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-quobyte-e6b5d959-1a1b-45f6-81df-d8af78aa4f50" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1ef7a9a9-e80f-4d7c-beba-f007c3e59491 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-e6b5d959-1a1b-45f6-81df-d8af78aa4f50" acquired by "delete_volume" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c4e3b2-f8b8-434e-a0f6-2059f1e955e4]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1ef7a9a9-e80f-4d7c-beba-f007c3e59491 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e6b5d959-1a1b-45f6-81df-d8af78aa4f50 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:54 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b43776fd-5ab3-457f-9c2f-bff450785044 1073741824" returned: 0 in 0.565s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b43776fd-5ab3-457f-9c2f-bff450785044 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:54 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e6b5d959-1a1b-45f6-81df-d8af78aa4f50 Sep 25 17:17:54 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:54 devstack sudo[102146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b43776fd-5ab3-457f-9c2f-bff450785044 Sep 25 17:17:54 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:54 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b43776fd-5ab3-457f-9c2f-bff450785044" returned: 0 in 0.300s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:54 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1ef7a9a9-e80f-4d7c-beba-f007c3e59491 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e6b5d959-1a1b-45f6-81df-d8af78aa4f50" returned: 0 in 0.443s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Attempting download of 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}])) to volume b43776fd-5ab3-457f-9c2f-bff450785044. {{(pid=87211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1ef7a9a9-e80f-4d7c-beba-f007c3e59491 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e6b5d959-1a1b-45f6-81df-d8af78aa4f50 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:54 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e6b5d959-1a1b-45f6-81df-d8af78aa4f50 Sep 25 17:17:54 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db1c324-4610-4e3e-a755-88db75a26719]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_bdkmxbd9 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:54 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_bdkmxbd9 Sep 25 17:17:54 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:54 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1ef7a9a9-e80f-4d7c-beba-f007c3e59491 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e6b5d959-1a1b-45f6-81df-d8af78aa4f50" returned: 0 in 0.310s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1ef7a9a9-e80f-4d7c-beba-f007c3e59491 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-e6b5d959-1a1b-45f6-81df-d8af78aa4f50" released by "delete_volume" :: held 0.813s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-1ef7a9a9-e80f-4d7c-beba-f007c3e59491 tempest-VolumesSnapshotTestJSON-2017449264 None] Created reservations ['6e03dffa-9751-497a-8c40-511bc39247c7', '43cfd60f-fd93-4dc9-83a0-69416f6584b4', '8906bc6a-2875-45d0-827e-b9034f1dee21', '1906eef8-1624-4a11-8d36-8748af6967ad'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:17:55 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_bdkmxbd9" returned: 0 in 0.510s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_bdkmxbd9 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1ef7a9a9-e80f-4d7c-beba-f007c3e59491 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1ef7a9a9-e80f-4d7c-beba-f007c3e59491 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1ef7a9a9-e80f-4d7c-beba-f007c3e59491 tempest-VolumesSnapshotTestJSON-2017449264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1ef7a9a9-e80f-4d7c-beba-f007c3e59491 tempest-VolumesSnapshotTestJSON-2017449264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1ef7a9a9-e80f-4d7c-beba-f007c3e59491 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1ef7a9a9-e80f-4d7c-beba-f007c3e59491 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:55 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:17:55 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d42f54db-eb34-41bc-a95b-ae1e6e3b56e7 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-4b18736a-7e53-4bcb-9944-531284d4110c-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:55 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_bdkmxbd9 Sep 25 17:17:55 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d42f54db-eb34-41bc-a95b-ae1e6e3b56e7 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-4b18736a-7e53-4bcb-9944-531284d4110c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d42f54db-eb34-41bc-a95b-ae1e6e3b56e7 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-quobyte-f097b589-d95a-4c94-b5c0-9b9b86b7d5de" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d42f54db-eb34-41bc-a95b-ae1e6e3b56e7 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-f097b589-d95a-4c94-b5c0-9b9b86b7d5de" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d42f54db-eb34-41bc-a95b-ae1e6e3b56e7 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-quobyte-4b18736a-7e53-4bcb-9944-531284d4110c" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d42f54db-eb34-41bc-a95b-ae1e6e3b56e7 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-4b18736a-7e53-4bcb-9944-531284d4110c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-d42f54db-eb34-41bc-a95b-ae1e6e3b56e7 tempest-VolumesSnapshotTestJSON-2017449264 None] Deleting offline snapshot 4b18736a-7e53-4bcb-9944-531284d4110c of volume f097b589-d95a-4c94-b5c0-9b9b86b7d5de {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-d42f54db-eb34-41bc-a95b-ae1e6e3b56e7 tempest-VolumesSnapshotTestJSON-2017449264 None] snapshot_file for this snap is: volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2ca677-7c40-43fd-bc8f-4e4332280304]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d42f54db-eb34-41bc-a95b-ae1e6e3b56e7 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:55 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1ef7a9a9-e80f-4d7c-beba-f007c3e59491 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.364s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-1ef7a9a9-e80f-4d7c-beba-f007c3e59491 tempest-VolumesSnapshotTestJSON-2017449264 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:17:55 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_bdkmxbd9" returned: 1 in 0.450s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_bdkmxbd9' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:17:55 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-1ef7a9a9-e80f-4d7c-beba-f007c3e59491 tempest-VolumesSnapshotTestJSON-2017449264 None] Deleted volume successfully. Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c2465d-0c84-431f-ab23-4165cf0ea5f4]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_m0m9ax2hdevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:55 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c Sep 25 17:17:55 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1ef7a9a9-e80f-4d7c-beba-f007c3e59491 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-e6b5d959-1a1b-45f6-81df-d8af78aa4f50-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:55 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_m0m9ax2hdevstack@QuobyteHD Sep 25 17:17:55 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:55 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d42f54db-eb34-41bc-a95b-ae1e6e3b56e7 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c" returned: 0 in 0.499s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-d42f54db-eb34-41bc-a95b-ae1e6e3b56e7 tempest-VolumesSnapshotTestJSON-2017449264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:17:56 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[41177e3f-7092-449e-ab88-bf711dff2360]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d42f54db-eb34-41bc-a95b-ae1e6e3b56e7 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:56 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_m0m9ax2hdevstack@QuobyteHD" returned: 0 in 0.450s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:56 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 was qcow2, converting to qcow2 {{(pid=87211) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 17:17:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_m0m9ax2hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b43776fd-5ab3-457f-9c2f-bff450785044 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:56 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_m0m9ax2hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b43776fd-5ab3-457f-9c2f-bff450785044 Sep 25 17:17:56 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:56 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de Sep 25 17:17:56 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:56 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d42f54db-eb34-41bc-a95b-ae1e6e3b56e7 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de" returned: 0 in 0.677s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d42f54db-eb34-41bc-a95b-ae1e6e3b56e7 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:56 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c Sep 25 17:17:56 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:57 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d42f54db-eb34-41bc-a95b-ae1e6e3b56e7 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c" returned: 0 in 0.518s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d42f54db-eb34-41bc-a95b-ae1e6e3b56e7 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:57 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c Sep 25 17:17:57 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:57 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d42f54db-eb34-41bc-a95b-ae1e6e3b56e7 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de.4b18736a-7e53-4bcb-9944-531284d4110c" returned: 0 in 0.370s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d42f54db-eb34-41bc-a95b-ae1e6e3b56e7 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-4b18736a-7e53-4bcb-9944-531284d4110c" released by "_delete_snapshot" :: held 2.266s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d42f54db-eb34-41bc-a95b-ae1e6e3b56e7 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-f097b589-d95a-4c94-b5c0-9b9b86b7d5de" released by "delete_snapshot" :: held 2.299s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:57 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-d42f54db-eb34-41bc-a95b-ae1e6e3b56e7 tempest-VolumesSnapshotTestJSON-2017449264 None] Created reservations ['e10f180e-02a8-4db5-9a2f-0d2642ca6ef6', '031495f9-4af6-4613-888c-4f5cc13347eb', '2a5f9bc3-3ba6-4e6d-8d4a-59991e5007bb', '302f2caa-11b8-4b02-95c1-43579a5543bf'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:17:57 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-d42f54db-eb34-41bc-a95b-ae1e6e3b56e7 tempest-VolumesSnapshotTestJSON-2017449264 None] Delete snapshot completed successfully. Sep 25 17:17:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d42f54db-eb34-41bc-a95b-ae1e6e3b56e7 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-4b18736a-7e53-4bcb-9944-531284d4110c-delete_snapshot" released by "delete_snapshot" :: held 2.519s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:58 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_m0m9ax2hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b43776fd-5ab3-457f-9c2f-bff450785044" returned: 0 in 2.480s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:58 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_81fcb778-9cb0-42b8-b1cb-70f4a455b8a0_m0m9ax2hdevstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b43776fd-5ab3-457f-9c2f-bff450785044 {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:17:58 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Converted 112.00 MB image at 45.15 MB/s Sep 25 17:17:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b43776fd-5ab3-457f-9c2f-bff450785044 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:58 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b43776fd-5ab3-457f-9c2f-bff450785044 1G Sep 25 17:17:58 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eeb61344-71d5-4768-bfea-72405e85fc29 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-f097b589-d95a-4c94-b5c0-9b9b86b7d5de-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eeb61344-71d5-4768-bfea-72405e85fc29 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-f097b589-d95a-4c94-b5c0-9b9b86b7d5de-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eeb61344-71d5-4768-bfea-72405e85fc29 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-quobyte-f097b589-d95a-4c94-b5c0-9b9b86b7d5de" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eeb61344-71d5-4768-bfea-72405e85fc29 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-f097b589-d95a-4c94-b5c0-9b9b86b7d5de" acquired by "delete_volume" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:58 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[a466df42-09b4-4990-a7b7-58f60a560fe6]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eeb61344-71d5-4768-bfea-72405e85fc29 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:58 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de Sep 25 17:17:58 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:58 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b43776fd-5ab3-457f-9c2f-bff450785044 1G" returned: 0 in 0.394s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:58 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Downloaded image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}])) to volume b43776fd-5ab3-457f-9c2f-bff450785044 successfully. {{(pid=87211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 17:17:58 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Temporary image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 for user 2e58634ed763407b861dda8605cebba3 is deleted. {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 17:17:58 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Marking volume b43776fd-5ab3-457f-9c2f-bff450785044 as bootable. {{(pid=87211) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 17:17:59 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Copying metadata from image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 to b43776fd-5ab3-457f-9c2f-bff450785044. {{(pid=87211) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 17:17:59 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Creating volume glance metadata for volume b43776fd-5ab3-457f-9c2f-bff450785044 backed by image 81fcb778-9cb0-42b8-b1cb-70f4a455b8a0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87211) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 17:17:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66bcd1f-b98b-4236-8718-1e2af729b881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b43776fd-5ab3-457f-9c2f-bff450785044', 'volume_size': 1, 'image_id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'acaf9a5e9cfc4af3b32eda10c91e30fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81fcb778-9cb0-42b8-b1cb-70f4a455b8a0', 'created_at': datetime.datetime(2026, 9, 25, 14, 58, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81fcb778-9cb0-42b8-b1cb-70f4a455b8a0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a62a86-7acd-427b-9ddf-481fbd745b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:59 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Volume volume-b43776fd-5ab3-457f-9c2f-bff450785044 (b43776fd-5ab3-457f-9c2f-bff450785044): created successfully Sep 25 17:17:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a62a86-7acd-427b-9ddf-481fbd745b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Flow 'volume_create_manager' (350191cf-432c-49c0-915a-3e8365b0c8f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:59 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-985e6496-b124-420c-83b8-5af7f5eea397 tempest-TestShelveInstance-1770032521 None] Created volume successfully. Sep 25 17:17:59 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eeb61344-71d5-4768-bfea-72405e85fc29 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de" returned: 0 in 0.472s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eeb61344-71d5-4768-bfea-72405e85fc29 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:59 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de Sep 25 17:17:59 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:59 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eeb61344-71d5-4768-bfea-72405e85fc29 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f097b589-d95a-4c94-b5c0-9b9b86b7d5de" returned: 0 in 0.281s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eeb61344-71d5-4768-bfea-72405e85fc29 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-f097b589-d95a-4c94-b5c0-9b9b86b7d5de" released by "delete_volume" :: held 0.839s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:59 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-eeb61344-71d5-4768-bfea-72405e85fc29 tempest-VolumesSnapshotTestJSON-2017449264 None] Created reservations ['eedad166-26cf-4725-ae93-3c73bc5a0780', '9c7d8aac-0ae1-41d5-8c45-5d94a2dcfb75', '9f136a53-e360-438d-8ad5-69eda5fc0f0c', 'd0319515-b16a-4e47-9c61-81ffd0d67591'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:17:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eeb61344-71d5-4768-bfea-72405e85fc29 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eeb61344-71d5-4768-bfea-72405e85fc29 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:59 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-eeb61344-71d5-4768-bfea-72405e85fc29 tempest-VolumesSnapshotTestJSON-2017449264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:59 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-eeb61344-71d5-4768-bfea-72405e85fc29 tempest-VolumesSnapshotTestJSON-2017449264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eeb61344-71d5-4768-bfea-72405e85fc29 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eeb61344-71d5-4768-bfea-72405e85fc29 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:59 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:17:59 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f5563102-b01d-4ee5-9a7e-7b402b267826 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-4a2f6a6a-61b5-4a58-9789-c797cc0055b0-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f5563102-b01d-4ee5-9a7e-7b402b267826 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-4a2f6a6a-61b5-4a58-9789-c797cc0055b0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:00 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eeb61344-71d5-4768-bfea-72405e85fc29 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.364s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:00 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-eeb61344-71d5-4768-bfea-72405e85fc29 tempest-VolumesSnapshotTestJSON-2017449264 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:18:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f5563102-b01d-4ee5-9a7e-7b402b267826 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "cinder-quobyte-4a2f6a6a-61b5-4a58-9789-c797cc0055b0" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:00 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-eeb61344-71d5-4768-bfea-72405e85fc29 tempest-VolumesSnapshotTestJSON-2017449264 None] Deleted volume successfully. Sep 25 17:18:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f5563102-b01d-4ee5-9a7e-7b402b267826 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-4a2f6a6a-61b5-4a58-9789-c797cc0055b0" acquired by "delete_volume" :: waited 0.030s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eeb61344-71d5-4768-bfea-72405e85fc29 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-f097b589-d95a-4c94-b5c0-9b9b86b7d5de-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:00 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf95a08-efcc-48b5-8d26-8a585f5bfb51]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f5563102-b01d-4ee5-9a7e-7b402b267826 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:00 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0 Sep 25 17:18:00 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:00 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f5563102-b01d-4ee5-9a7e-7b402b267826 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0" returned: 0 in 0.468s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f5563102-b01d-4ee5-9a7e-7b402b267826 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:00 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0 Sep 25 17:18:00 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:01 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f5563102-b01d-4ee5-9a7e-7b402b267826 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4a2f6a6a-61b5-4a58-9789-c797cc0055b0" returned: 0 in 0.502s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f5563102-b01d-4ee5-9a7e-7b402b267826 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-quobyte-4a2f6a6a-61b5-4a58-9789-c797cc0055b0" released by "delete_volume" :: held 1.078s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:01 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-f5563102-b01d-4ee5-9a7e-7b402b267826 tempest-VolumesSnapshotTestJSON-2017449264 None] Created reservations ['c8e82dc7-2cc5-4d5d-9ef5-6668330f3058', '92dc791f-1d4d-4b68-87c6-859410a6c9e4', 'edeba56e-0fc4-4bd7-abf6-6f26d7c054d8', '51cd0a4e-5011-455f-8032-07ad9d6975c7'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:18:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f5563102-b01d-4ee5-9a7e-7b402b267826 tempest-VolumesSnapshotTestJSON-2017449264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f5563102-b01d-4ee5-9a7e-7b402b267826 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f5563102-b01d-4ee5-9a7e-7b402b267826 tempest-VolumesSnapshotTestJSON-2017449264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:18:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f5563102-b01d-4ee5-9a7e-7b402b267826 tempest-VolumesSnapshotTestJSON-2017449264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:18:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f5563102-b01d-4ee5-9a7e-7b402b267826 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f5563102-b01d-4ee5-9a7e-7b402b267826 tempest-VolumesSnapshotTestJSON-2017449264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:01 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:18:01 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:01 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f5563102-b01d-4ee5-9a7e-7b402b267826 tempest-VolumesSnapshotTestJSON-2017449264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.404s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:01 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-f5563102-b01d-4ee5-9a7e-7b402b267826 tempest-VolumesSnapshotTestJSON-2017449264 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:18:01 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-f5563102-b01d-4ee5-9a7e-7b402b267826 tempest-VolumesSnapshotTestJSON-2017449264 None] Deleted volume successfully. Sep 25 17:18:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f5563102-b01d-4ee5-9a7e-7b402b267826 tempest-VolumesSnapshotTestJSON-2017449264 None] Lock "cinder-4a2f6a6a-61b5-4a58-9789-c797cc0055b0-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-d9f2bed2-04bc-449a-bf84-651cfff1d2e5 req-5bb36740-5d79-4612-9188-3aa60ac52a5f tempest-TestShelveInstance-1770032521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-d9f2bed2-04bc-449a-bf84-651cfff1d2e5 req-5bb36740-5d79-4612-9188-3aa60ac52a5f tempest-TestShelveInstance-1770032521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-d9f2bed2-04bc-449a-bf84-651cfff1d2e5 req-5bb36740-5d79-4612-9188-3aa60ac52a5f tempest-TestShelveInstance-1770032521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-d9f2bed2-04bc-449a-bf84-651cfff1d2e5 req-5bb36740-5d79-4612-9188-3aa60ac52a5f tempest-TestShelveInstance-1770032521 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-b43776fd-5ab3-457f-9c2f-bff450785044', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62e2971a-a67e-4c27-b949-80f752705b4a', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:18:03 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-d9f2bed2-04bc-449a-bf84-651cfff1d2e5 req-5bb36740-5d79-4612-9188-3aa60ac52a5f tempest-TestShelveInstance-1770032521 None] attachment_update completed successfully. Sep 25 17:18:04 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:18:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Flow 'volume_create_manager' (6cb4ddeb-e3c9-46df-b95a-f9da043329d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:18:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e570c51-0061-408b-951c-510f66d2d973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e570c51-0061-408b-951c-510f66d2d973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-784957635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30756c1a-c82b-4267-a36c-b0a81929dbd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99098d0616604af2835ca5288cf418c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:05Z,use_quota=True,user_id='b9d54ce3b95f45f39f94a396a20bb272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc4541f-9b35-409b-954d-5ae039417d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc4541f-9b35-409b-954d-5ae039417d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85434826-4b7f-4679-9d3e-9b07aa3461f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85434826-4b7f-4679-9d3e-9b07aa3461f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30756c1a-c82b-4267-a36c-b0a81929dbd0', 'volume_name': 'volume-30756c1a-c82b-4267-a36c-b0a81929dbd0', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44bce723-9265-4c3a-8c1e-a6e5264c3e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44bce723-9265-4c3a-8c1e-a6e5264c3e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33475ab7-916c-4eae-a151-0cb439051eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:04 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Volume 30756c1a-c82b-4267-a36c-b0a81929dbd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30756c1a-c82b-4267-a36c-b0a81929dbd0', 'volume_size': 1} Sep 25 17:18:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:04 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-784957635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30756c1a-c82b-4267-a36c-b0a81929dbd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99098d0616604af2835ca5288cf418c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:05Z,use_quota=True,user_id='b9d54ce3b95f45f39f94a396a20bb272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:18:04 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Creating volume 30756c1a-c82b-4267-a36c-b0a81929dbd0 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:18:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:04 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:18:04 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:18:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:04 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:18:04 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:18:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30756c1a-c82b-4267-a36c-b0a81929dbd0 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:04 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30756c1a-c82b-4267-a36c-b0a81929dbd0 1073741824 Sep 25 17:18:04 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:05 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30756c1a-c82b-4267-a36c-b0a81929dbd0 1073741824" returned: 0 in 0.606s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30756c1a-c82b-4267-a36c-b0a81929dbd0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:05 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30756c1a-c82b-4267-a36c-b0a81929dbd0 Sep 25 17:18:05 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:05 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30756c1a-c82b-4267-a36c-b0a81929dbd0" returned: 0 in 0.333s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:18:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33475ab7-916c-4eae-a151-0cb439051eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30756c1a-c82b-4267-a36c-b0a81929dbd0', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (526f0d87-53c8-48a0-a964-42db2ba4a640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:05 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Volume volume-30756c1a-c82b-4267-a36c-b0a81929dbd0 (30756c1a-c82b-4267-a36c-b0a81929dbd0): created successfully Sep 25 17:18:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (526f0d87-53c8-48a0-a964-42db2ba4a640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Flow 'volume_create_manager' (6cb4ddeb-e3c9-46df-b95a-f9da043329d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:18:06 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-d74daf22-3f99-4502-bf8d-1f49faa961a5 tempest-AttachVolumeNegativeTest-878525210 None] Created volume successfully. Sep 25 17:18:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-f77f3469-2486-4dc9-92ed-7255acd9a047 req-dd08899d-9661-4db2-9dfc-89e941c51726 tempest-AttachVolumeNegativeTest-878525210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-f77f3469-2486-4dc9-92ed-7255acd9a047 req-dd08899d-9661-4db2-9dfc-89e941c51726 tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-f77f3469-2486-4dc9-92ed-7255acd9a047 req-dd08899d-9661-4db2-9dfc-89e941c51726 tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-f77f3469-2486-4dc9-92ed-7255acd9a047 req-dd08899d-9661-4db2-9dfc-89e941c51726 tempest-AttachVolumeNegativeTest-878525210 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-30756c1a-c82b-4267-a36c-b0a81929dbd0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '80b15169-6443-4ff7-9617-2d57b639eca5', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:18:07 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-f77f3469-2486-4dc9-92ed-7255acd9a047 req-dd08899d-9661-4db2-9dfc-89e941c51726 tempest-AttachVolumeNegativeTest-878525210 None] attachment_update completed successfully. Sep 25 17:18:10 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-34245adc-caee-4580-9f8f-2997b0285eb1 req-94b661c3-a4e5-48c9-9101-6bf4081683df tempest-AttachVolumeNegativeTest-878525210 None] Terminate volume connection completed successfully. Sep 25 17:18:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-34245adc-caee-4580-9f8f-2997b0285eb1 req-94b661c3-a4e5-48c9-9101-6bf4081683df tempest-AttachVolumeNegativeTest-878525210 None] Deleting attachment 80b15169-6443-4ff7-9617-2d57b639eca5. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:18:15 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=76,cinder:UPDATE=71,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:18:15 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=72,cinder:UPDATE=73,cinder:INSERT=25,cinder:DELETE=5 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:18:15 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:18:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Flow 'volume_create_manager' (577d1702-63fb-493e-8562-a8abebc9a0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:18:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c660652a-4f22-4209-9d47-cd505461c179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c660652a-4f22-4209-9d47-cd505461c179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-42421823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60ddfc1-bbe7-4bb8-a905-89e06b5840a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1b5ed9a09c46479086b7aa93a3b2ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:16Z,use_quota=True,user_id='8b18d25de6ac4a7ea0cf55622b70462b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f766a12-4d6c-4284-9086-6187e8092ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f766a12-4d6c-4284-9086-6187e8092ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b524680-5853-49a0-8675-c55ec7d5a163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b524680-5853-49a0-8675-c55ec7d5a163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd60ddfc1-bbe7-4bb8-a905-89e06b5840a6', 'volume_name': 'volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6541adb3-0a9e-462d-90b1-a29a56d65813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6541adb3-0a9e-462d-90b1-a29a56d65813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c5c2d7-5783-4aa5-9e8b-de6b3d0982bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:16 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Volume d60ddfc1-bbe7-4bb8-a905-89e06b5840a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6', 'volume_size': 1} Sep 25 17:18:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-42421823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60ddfc1-bbe7-4bb8-a905-89e06b5840a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1b5ed9a09c46479086b7aa93a3b2ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:16Z,use_quota=True,user_id='8b18d25de6ac4a7ea0cf55622b70462b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:18:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Creating volume d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:18:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:18:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:18:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:18:16 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:18:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:16 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 1073741824 Sep 25 17:18:16 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:16 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 1073741824" returned: 0 in 0.749s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:16 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 Sep 25 17:18:16 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:17 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6" returned: 0 in 0.394s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:18:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c5c2d7-5783-4aa5-9e8b-de6b3d0982bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992dc03f-8c20-4f14-a11e-04e1e8885d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:17 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Volume volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 (d60ddfc1-bbe7-4bb8-a905-89e06b5840a6): created successfully Sep 25 17:18:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992dc03f-8c20-4f14-a11e-04e1e8885d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Flow 'volume_create_manager' (577d1702-63fb-493e-8562-a8abebc9a0ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:18:17 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-f7d07705-1060-44b5-8c38-822c305a5284 tempest-VolumeDependencyTests-820484470 None] Created volume successfully. Sep 25 17:18:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8d071cdb-d070-43ff-b073-3b6a85eae6ca tempest-VolumeDependencyTests-820484470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8d071cdb-d070-43ff-b073-3b6a85eae6ca tempest-VolumeDependencyTests-820484470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:18 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-8d071cdb-d070-43ff-b073-3b6a85eae6ca tempest-VolumeDependencyTests-820484470 None] Creating offline snapshot 5716a961-7f66-42c1-9fd0-2c1d062f9ec3 of volume d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:18:18 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b22250-b879-44fe-9bf4-88177c41ab4f]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8d071cdb-d070-43ff-b073-3b6a85eae6ca tempest-VolumeDependencyTests-820484470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:19 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 Sep 25 17:18:19 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:19 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8d071cdb-d070-43ff-b073-3b6a85eae6ca tempest-VolumeDependencyTests-820484470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6" returned: 0 in 1.040s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8d071cdb-d070-43ff-b073-3b6a85eae6ca tempest-VolumeDependencyTests-820484470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:19 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3 1G Sep 25 17:18:19 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:20 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:18:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Flow 'volume_create_manager' (36393648-ed48-4ee3-9b20-690026bb097f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:18:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e03161b0-15f2-4bea-b61e-1fc9d3bb32ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e03161b0-15f2-4bea-b61e-1fc9d3bb32ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-76360774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e998b789-6d68-41af-8b35-2639d4bec31b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54290dd00cc844d3b9a88729155e68e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:20Z,use_quota=True,user_id='944f9a4d4ee34966ae362c586c42d52c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bf42691-5b76-44bd-8f61-2c8c4bb1d9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bf42691-5b76-44bd-8f61-2c8c4bb1d9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac55330-796d-447a-95ba-d5284365aecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:20 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac55330-796d-447a-95ba-d5284365aecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e998b789-6d68-41af-8b35-2639d4bec31b', 'volume_name': 'volume-e998b789-6d68-41af-8b35-2639d4bec31b', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ac4a7c-0802-4719-a317-c96248cfd16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ac4a7c-0802-4719-a317-c96248cfd16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64c5614-eedd-4180-b53b-6a628069aa25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:20 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Volume e998b789-6d68-41af-8b35-2639d4bec31b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e998b789-6d68-41af-8b35-2639d4bec31b', 'volume_size': 1} Sep 25 17:18:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8d071cdb-d070-43ff-b073-3b6a85eae6ca tempest-VolumeDependencyTests-820484470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3 1G" returned: 0 in 1.075s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8d071cdb-d070-43ff-b073-3b6a85eae6ca tempest-VolumeDependencyTests-820484470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:20 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3 Sep 25 17:18:20 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:21 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8d071cdb-d070-43ff-b073-3b6a85eae6ca tempest-VolumeDependencyTests-820484470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3" returned: 0 in 0.406s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:21 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-8d071cdb-d070-43ff-b073-3b6a85eae6ca tempest-VolumeDependencyTests-820484470 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3 is being set with open permissions: ugo+rw Sep 25 17:18:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8d071cdb-d070-43ff-b073-3b6a85eae6ca tempest-VolumeDependencyTests-820484470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:21 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3 Sep 25 17:18:21 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:21 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8d071cdb-d070-43ff-b073-3b6a85eae6ca tempest-VolumeDependencyTests-820484470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3" returned: 0 in 0.367s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8d071cdb-d070-43ff-b073-3b6a85eae6ca tempest-VolumeDependencyTests-820484470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-90393cac-5ec6-4055-af3d-89d213d4cbbf tempest-AttachVolumeNegativeTest-878525210 None] Acquiring lock "cinder-30756c1a-c82b-4267-a36c-b0a81929dbd0-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:21 devstack sudo[103261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.info Sep 25 17:18:21 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-90393cac-5ec6-4055-af3d-89d213d4cbbf tempest-AttachVolumeNegativeTest-878525210 None] Lock "cinder-30756c1a-c82b-4267-a36c-b0a81929dbd0-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-90393cac-5ec6-4055-af3d-89d213d4cbbf tempest-AttachVolumeNegativeTest-878525210 None] Acquiring lock "cinder-quobyte-30756c1a-c82b-4267-a36c-b0a81929dbd0" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-90393cac-5ec6-4055-af3d-89d213d4cbbf tempest-AttachVolumeNegativeTest-878525210 None] Lock "cinder-quobyte-30756c1a-c82b-4267-a36c-b0a81929dbd0" acquired by "delete_volume" :: waited 0.030s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:21 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cf9b3e-b641-46d8-ac6c-662fad75580a]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-90393cac-5ec6-4055-af3d-89d213d4cbbf tempest-AttachVolumeNegativeTest-878525210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30756c1a-c82b-4267-a36c-b0a81929dbd0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:22 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8d071cdb-d070-43ff-b073-3b6a85eae6ca tempest-VolumeDependencyTests-820484470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.info" returned: 0 in 0.427s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:22 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-8d071cdb-d070-43ff-b073-3b6a85eae6ca tempest-VolumeDependencyTests-820484470 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.info is being set with open permissions: ugo+rw Sep 25 17:18:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8d071cdb-d070-43ff-b073-3b6a85eae6ca tempest-VolumeDependencyTests-820484470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:22 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30756c1a-c82b-4267-a36c-b0a81929dbd0 Sep 25 17:18:22 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:22 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.info Sep 25 17:18:22 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:22 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8d071cdb-d070-43ff-b073-3b6a85eae6ca tempest-VolumeDependencyTests-820484470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.info" returned: 0 in 0.345s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8d071cdb-d070-43ff-b073-3b6a85eae6ca tempest-VolumeDependencyTests-820484470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.913s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.680s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-76360774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e998b789-6d68-41af-8b35-2639d4bec31b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54290dd00cc844d3b9a88729155e68e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:20Z,use_quota=True,user_id='944f9a4d4ee34966ae362c586c42d52c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:18:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Creating volume e998b789-6d68-41af-8b35-2639d4bec31b {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:18:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:18:22 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:18:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:18:22 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:18:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-90393cac-5ec6-4055-af3d-89d213d4cbbf tempest-AttachVolumeNegativeTest-878525210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30756c1a-c82b-4267-a36c-b0a81929dbd0" returned: 0 in 0.576s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-90393cac-5ec6-4055-af3d-89d213d4cbbf tempest-AttachVolumeNegativeTest-878525210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30756c1a-c82b-4267-a36c-b0a81929dbd0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:22 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b 1073741824 Sep 25 17:18:22 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:22 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30756c1a-c82b-4267-a36c-b0a81929dbd0 Sep 25 17:18:22 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:22 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-8d071cdb-d070-43ff-b073-3b6a85eae6ca tempest-VolumeDependencyTests-820484470 None] Create snapshot completed successfully Sep 25 17:18:23 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-90393cac-5ec6-4055-af3d-89d213d4cbbf tempest-AttachVolumeNegativeTest-878525210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30756c1a-c82b-4267-a36c-b0a81929dbd0" returned: 0 in 0.490s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-90393cac-5ec6-4055-af3d-89d213d4cbbf tempest-AttachVolumeNegativeTest-878525210 None] Lock "cinder-quobyte-30756c1a-c82b-4267-a36c-b0a81929dbd0" released by "delete_volume" :: held 1.137s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-90393cac-5ec6-4055-af3d-89d213d4cbbf tempest-AttachVolumeNegativeTest-878525210 None] Created reservations ['4bf108ac-6b97-4f9b-9b0a-9e2fc5409b26', '32630c4c-dcf4-4f6f-b89c-29a49a746f08', 'd46214ed-732e-492e-b1e6-cefbcd12f6bb', '05e9fa79-05d0-46c3-96a1-4e70d2ffac41'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:18:23 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b 1073741824" returned: 0 in 0.716s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-90393cac-5ec6-4055-af3d-89d213d4cbbf tempest-AttachVolumeNegativeTest-878525210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-90393cac-5ec6-4055-af3d-89d213d4cbbf tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-90393cac-5ec6-4055-af3d-89d213d4cbbf tempest-AttachVolumeNegativeTest-878525210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-90393cac-5ec6-4055-af3d-89d213d4cbbf tempest-AttachVolumeNegativeTest-878525210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-90393cac-5ec6-4055-af3d-89d213d4cbbf tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-90393cac-5ec6-4055-af3d-89d213d4cbbf tempest-AttachVolumeNegativeTest-878525210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:23 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:18:23 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:23 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b Sep 25 17:18:23 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:23 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b" returned: 0 in 0.399s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:23 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-90393cac-5ec6-4055-af3d-89d213d4cbbf tempest-AttachVolumeNegativeTest-878525210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.457s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-90393cac-5ec6-4055-af3d-89d213d4cbbf tempest-AttachVolumeNegativeTest-878525210 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64c5614-eedd-4180-b53b-6a628069aa25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e998b789-6d68-41af-8b35-2639d4bec31b', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8b261e-741c-40dc-a804-9f14d424fd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:23 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-90393cac-5ec6-4055-af3d-89d213d4cbbf tempest-AttachVolumeNegativeTest-878525210 None] Deleted volume successfully. Sep 25 17:18:23 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Volume volume-e998b789-6d68-41af-8b35-2639d4bec31b (e998b789-6d68-41af-8b35-2639d4bec31b): created successfully Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8b261e-741c-40dc-a804-9f14d424fd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Flow 'volume_create_manager' (36393648-ed48-4ee3-9b20-690026bb097f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-90393cac-5ec6-4055-af3d-89d213d4cbbf tempest-AttachVolumeNegativeTest-878525210 None] Lock "cinder-30756c1a-c82b-4267-a36c-b0a81929dbd0-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:23 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-dea2ea84-3da9-47bf-9f52-963f567db485 tempest-TestImageHashVerification-1470157824 None] Created volume successfully. Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Flow 'volume_create_manager' (b1975c7e-1dce-4211-95e2-f28935318902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9740e48c-be67-448e-8373-c8cc67595772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9740e48c-be67-448e-8373-c8cc67595772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1402072880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29d506d-c66d-4f65-9aae-460b668e5476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1b5ed9a09c46479086b7aa93a3b2ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5716a961-7f66-42c1-9fd0-2c1d062f9ec3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:24Z,use_quota=True,user_id='8b18d25de6ac4a7ea0cf55622b70462b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (397ccd2b-50f8-4747-bea4-d660f4be2215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (397ccd2b-50f8-4747-bea4-d660f4be2215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2ad885-079a-455e-9c65-0b4b6f522202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2ad885-079a-455e-9c65-0b4b6f522202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c29d506d-c66d-4f65-9aae-460b668e5476', 'volume_name': 'volume-c29d506d-c66d-4f65-9aae-460b668e5476', 'volume_size': 1, 'snapshot_id': '5716a961-7f66-42c1-9fd0-2c1d062f9ec3'}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2ce10c-359f-4564-b793-67c6698976b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2ce10c-359f-4564-b793-67c6698976b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768482ae-a985-4061-b934-bd118b3ec838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:23 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Volume c29d506d-c66d-4f65-9aae-460b668e5476: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c29d506d-c66d-4f65-9aae-460b668e5476', 'volume_size': 1, 'snapshot_id': '5716a961-7f66-42c1-9fd0-2c1d062f9ec3'} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Acquiring lock "cinder-quobyte-5716a961-7f66-42c1-9fd0-2c1d062f9ec3-c29d506d-c66d-4f65-9aae-460b668e5476" by "_create_volume_from_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Lock "cinder-quobyte-5716a961-7f66-42c1-9fd0-2c1d062f9ec3-c29d506d-c66d-4f65-9aae-460b668e5476" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Creating volume c29d506d-c66d-4f65-9aae-460b668e5476 from snapshot 5716a961-7f66-42c1-9fd0-2c1d062f9ec3 {{(pid=87211) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Acquiring lock "cinder-quobyte-c29d506d-c66d-4f65-9aae-460b668e5476" by "_copy_volume_from_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Lock "cinder-quobyte-c29d506d-c66d-4f65-9aae-460b668e5476" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] snapshot: 5716a961-7f66-42c1-9fd0-2c1d062f9ec3, volume: c29d506d-c66d-4f65-9aae-460b668e5476, {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec29de1-d794-489d-b9d0-1aec58f75bcb]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-207ca687-6a58-4369-a752-3bb3e3063f96 tempest-AttachVolumeNegativeTest-878525210 None] Acquiring lock "cinder-baca0f8e-f1ad-4703-8d06-631f3dda3cc2-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-207ca687-6a58-4369-a752-3bb3e3063f96 tempest-AttachVolumeNegativeTest-878525210 None] Lock "cinder-baca0f8e-f1ad-4703-8d06-631f3dda3cc2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:24 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3 Sep 25 17:18:24 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-207ca687-6a58-4369-a752-3bb3e3063f96 tempest-AttachVolumeNegativeTest-878525210 None] Acquiring lock "cinder-quobyte-baca0f8e-f1ad-4703-8d06-631f3dda3cc2" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-207ca687-6a58-4369-a752-3bb3e3063f96 tempest-AttachVolumeNegativeTest-878525210 None] Lock "cinder-quobyte-baca0f8e-f1ad-4703-8d06-631f3dda3cc2" acquired by "delete_volume" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42e8190-dc36-45d9-9b3f-0ba3ffd9a8b2]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-207ca687-6a58-4369-a752-3bb3e3063f96 tempest-AttachVolumeNegativeTest-878525210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-baca0f8e-f1ad-4703-8d06-631f3dda3cc2 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:24 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-baca0f8e-f1ad-4703-8d06-631f3dda3cc2 Sep 25 17:18:24 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:24 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3" returned: 0 in 0.771s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40b95c6-d14c-4c7a-becf-2e5fc4f6e611]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:24 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-207ca687-6a58-4369-a752-3bb3e3063f96 tempest-AttachVolumeNegativeTest-878525210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-baca0f8e-f1ad-4703-8d06-631f3dda3cc2" returned: 0 in 0.601s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-207ca687-6a58-4369-a752-3bb3e3063f96 tempest-AttachVolumeNegativeTest-878525210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-baca0f8e-f1ad-4703-8d06-631f3dda3cc2 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:25 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-baca0f8e-f1ad-4703-8d06-631f3dda3cc2 Sep 25 17:18:25 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:25 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 Sep 25 17:18:25 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:25 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-207ca687-6a58-4369-a752-3bb3e3063f96 tempest-AttachVolumeNegativeTest-878525210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-baca0f8e-f1ad-4703-8d06-631f3dda3cc2" returned: 0 in 0.296s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-207ca687-6a58-4369-a752-3bb3e3063f96 tempest-AttachVolumeNegativeTest-878525210 None] Lock "cinder-quobyte-baca0f8e-f1ad-4703-8d06-631f3dda3cc2" released by "delete_volume" :: held 0.961s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:25 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-207ca687-6a58-4369-a752-3bb3e3063f96 tempest-AttachVolumeNegativeTest-878525210 None] Created reservations ['b38f967d-afb3-4535-b5e8-bac1b2c7fe76', '434d6f20-462e-41dc-bfad-dbccedd41f44', 'aba3b2b8-a87d-4298-acc1-ec676d306ec5', '6f89cc00-18a5-42ce-bfd6-cbd72842e7ba'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:18:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-207ca687-6a58-4369-a752-3bb3e3063f96 tempest-AttachVolumeNegativeTest-878525210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-207ca687-6a58-4369-a752-3bb3e3063f96 tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:25 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-207ca687-6a58-4369-a752-3bb3e3063f96 tempest-AttachVolumeNegativeTest-878525210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:18:25 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-207ca687-6a58-4369-a752-3bb3e3063f96 tempest-AttachVolumeNegativeTest-878525210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:18:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-207ca687-6a58-4369-a752-3bb3e3063f96 tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-207ca687-6a58-4369-a752-3bb3e3063f96 tempest-AttachVolumeNegativeTest-878525210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:25 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:18:25 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:25 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6" returned: 0 in 0.778s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:25 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] will copy from snapshot at /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:18:25 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Creating direct copy from snapshot {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:18:25 devstack cinder-volume[87211]: DEBUG cinder.utils [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Path /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c29d506d-c66d-4f65-9aae-460b668e5476 not found in is_blk_device check {{(pid=87211) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:18:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c29d506d-c66d-4f65-9aae-460b668e5476 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:25 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c29d506d-c66d-4f65-9aae-460b668e5476 Sep 25 17:18:25 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:25 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-207ca687-6a58-4369-a752-3bb3e3063f96 tempest-AttachVolumeNegativeTest-878525210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.391s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:25 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-207ca687-6a58-4369-a752-3bb3e3063f96 tempest-AttachVolumeNegativeTest-878525210 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:18:26 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-207ca687-6a58-4369-a752-3bb3e3063f96 tempest-AttachVolumeNegativeTest-878525210 None] Deleted volume successfully. Sep 25 17:18:26 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-207ca687-6a58-4369-a752-3bb3e3063f96 tempest-AttachVolumeNegativeTest-878525210 None] Lock "cinder-baca0f8e-f1ad-4703-8d06-631f3dda3cc2-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ada96275-142e-48b5-bab4-50ca80fcac3e tempest-TestImageHashVerification-1470157824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e19144e6-0b4d-4fbe-9db9-300bd944a0b3 tempest-AttachVolumeNegativeTest-878525210 None] Acquiring lock "cinder-cf93ed85-ed68-4ef6-b849-d8ca22fe9965-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e19144e6-0b4d-4fbe-9db9-300bd944a0b3 tempest-AttachVolumeNegativeTest-878525210 None] Lock "cinder-cf93ed85-ed68-4ef6-b849-d8ca22fe9965-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e19144e6-0b4d-4fbe-9db9-300bd944a0b3 tempest-AttachVolumeNegativeTest-878525210 None] Acquiring lock "cinder-quobyte-cf93ed85-ed68-4ef6-b849-d8ca22fe9965" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e19144e6-0b4d-4fbe-9db9-300bd944a0b3 tempest-AttachVolumeNegativeTest-878525210 None] Lock "cinder-quobyte-cf93ed85-ed68-4ef6-b849-d8ca22fe9965" acquired by "delete_volume" :: waited 0.025s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:27 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[722e2ec3-8d52-4568-a542-73c90a709cdf]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e19144e6-0b4d-4fbe-9db9-300bd944a0b3 tempest-AttachVolumeNegativeTest-878525210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cf93ed85-ed68-4ef6-b849-d8ca22fe9965 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:27 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cf93ed85-ed68-4ef6-b849-d8ca22fe9965 Sep 25 17:18:27 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:28 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e19144e6-0b4d-4fbe-9db9-300bd944a0b3 tempest-AttachVolumeNegativeTest-878525210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cf93ed85-ed68-4ef6-b849-d8ca22fe9965" returned: 0 in 0.774s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e19144e6-0b4d-4fbe-9db9-300bd944a0b3 tempest-AttachVolumeNegativeTest-878525210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cf93ed85-ed68-4ef6-b849-d8ca22fe9965 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:28 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cf93ed85-ed68-4ef6-b849-d8ca22fe9965 Sep 25 17:18:28 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:28 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e19144e6-0b4d-4fbe-9db9-300bd944a0b3 tempest-AttachVolumeNegativeTest-878525210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cf93ed85-ed68-4ef6-b849-d8ca22fe9965" returned: 0 in 0.591s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e19144e6-0b4d-4fbe-9db9-300bd944a0b3 tempest-AttachVolumeNegativeTest-878525210 None] Lock "cinder-quobyte-cf93ed85-ed68-4ef6-b849-d8ca22fe9965" released by "delete_volume" :: held 1.498s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:28 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-e19144e6-0b4d-4fbe-9db9-300bd944a0b3 tempest-AttachVolumeNegativeTest-878525210 None] Created reservations ['7b038c24-05c5-4718-bea6-3305b6fefc5b', '9745d22b-f38f-416b-8a4f-375976a13401', 'a3318bc8-4a62-4dbc-a892-dc65dffeb401', 'f82c0c6e-dd0d-4c62-b460-7a06086a69b6'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:18:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e19144e6-0b4d-4fbe-9db9-300bd944a0b3 tempest-AttachVolumeNegativeTest-878525210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e19144e6-0b4d-4fbe-9db9-300bd944a0b3 tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:28 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e19144e6-0b4d-4fbe-9db9-300bd944a0b3 tempest-AttachVolumeNegativeTest-878525210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:18:28 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e19144e6-0b4d-4fbe-9db9-300bd944a0b3 tempest-AttachVolumeNegativeTest-878525210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:18:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e19144e6-0b4d-4fbe-9db9-300bd944a0b3 tempest-AttachVolumeNegativeTest-878525210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e19144e6-0b4d-4fbe-9db9-300bd944a0b3 tempest-AttachVolumeNegativeTest-878525210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:28 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:18:29 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:29 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e19144e6-0b4d-4fbe-9db9-300bd944a0b3 tempest-AttachVolumeNegativeTest-878525210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.493s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:29 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-e19144e6-0b4d-4fbe-9db9-300bd944a0b3 tempest-AttachVolumeNegativeTest-878525210 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:18:29 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-e19144e6-0b4d-4fbe-9db9-300bd944a0b3 tempest-AttachVolumeNegativeTest-878525210 None] Deleted volume successfully. Sep 25 17:18:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e19144e6-0b4d-4fbe-9db9-300bd944a0b3 tempest-AttachVolumeNegativeTest-878525210 None] Lock "cinder-cf93ed85-ed68-4ef6-b849-d8ca22fe9965-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:34 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c29d506d-c66d-4f65-9aae-460b668e5476" returned: 0 in 9.086s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:34 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Image conversion details: src /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6, size 1024.00 MB, duration 9.09 sec, destination /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c29d506d-c66d-4f65-9aae-460b668e5476 {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:18:34 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Converted 1024.00 MB image at 112.69 MB/s Sep 25 17:18:34 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c29d506d-c66d-4f65-9aae-460b668e5476 is being set with open permissions: ugo+rw Sep 25 17:18:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c29d506d-c66d-4f65-9aae-460b668e5476 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:34 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c29d506d-c66d-4f65-9aae-460b668e5476 Sep 25 17:18:34 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:35 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c29d506d-c66d-4f65-9aae-460b668e5476" returned: 0 in 0.331s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Lock "cinder-quobyte-c29d506d-c66d-4f65-9aae-460b668e5476" released by "_copy_volume_from_snapshot" :: held 11.094s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Lock "cinder-quobyte-5716a961-7f66-42c1-9fd0-2c1d062f9ec3-c29d506d-c66d-4f65-9aae-460b668e5476" released by "_create_volume_from_snapshot" :: held 11.166s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.188s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ada96275-142e-48b5-bab4-50ca80fcac3e tempest-TestImageHashVerification-1470157824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 8.376s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:35 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[03251a5a-8934-4009-899f-1ceec12e0c53]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ada96275-142e-48b5-bab4-50ca80fcac3e tempest-TestImageHashVerification-1470157824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768482ae-a985-4061-b934-bd118b3ec838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29d506d-c66d-4f65-9aae-460b668e5476', 'volume_size': 1, 'snapshot_id': '5716a961-7f66-42c1-9fd0-2c1d062f9ec3'}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d09fb95-e58a-465f-b451-476f368f297e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:35 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Volume volume-c29d506d-c66d-4f65-9aae-460b668e5476 (c29d506d-c66d-4f65-9aae-460b668e5476): created successfully Sep 25 17:18:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d09fb95-e58a-465f-b451-476f368f297e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Flow 'volume_create_manager' (b1975c7e-1dce-4211-95e2-f28935318902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:18:35 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-7d8090a8-e116-49b1-818b-82be36de254d tempest-VolumeDependencyTests-820484470 None] Created volume successfully. Sep 25 17:18:35 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b Sep 25 17:18:35 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:35 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ada96275-142e-48b5-bab4-50ca80fcac3e tempest-TestImageHashVerification-1470157824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b" returned: 0 in 0.396s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:35 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a207b28-f9fe-4a49-af5f-18ade5ed2632]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ada96275-142e-48b5-bab4-50ca80fcac3e tempest-TestImageHashVerification-1470157824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:35 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b Sep 25 17:18:35 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:36 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ada96275-142e-48b5-bab4-50ca80fcac3e tempest-TestImageHashVerification-1470157824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b" returned: 0 in 0.446s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ada96275-142e-48b5-bab4-50ca80fcac3e tempest-TestImageHashVerification-1470157824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b /opt/stack/data/cinder/conversion/e998b789-6d68-41af-8b35-2639d4bec31b.temp_image.2cc23df1-3a84-4fb0-96d4-31005c6a6950pj4e_vzh.img {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:36 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b /opt/stack/data/cinder/conversion/e998b789-6d68-41af-8b35-2639d4bec31b.temp_image.2cc23df1-3a84-4fb0-96d4-31005c6a6950pj4e_vzh.img Sep 25 17:18:36 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b1b90784-e810-4385-a4ac-aee9ce509883 tempest-VolumeDependencyTests-820484470 None] Acquiring lock "cinder-5716a961-7f66-42c1-9fd0-2c1d062f9ec3-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b1b90784-e810-4385-a4ac-aee9ce509883 tempest-VolumeDependencyTests-820484470 None] Lock "cinder-5716a961-7f66-42c1-9fd0-2c1d062f9ec3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b1b90784-e810-4385-a4ac-aee9ce509883 tempest-VolumeDependencyTests-820484470 None] Acquiring lock "cinder-quobyte-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b1b90784-e810-4385-a4ac-aee9ce509883 tempest-VolumeDependencyTests-820484470 None] Lock "cinder-quobyte-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b1b90784-e810-4385-a4ac-aee9ce509883 tempest-VolumeDependencyTests-820484470 None] Acquiring lock "cinder-quobyte-5716a961-7f66-42c1-9fd0-2c1d062f9ec3" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b1b90784-e810-4385-a4ac-aee9ce509883 tempest-VolumeDependencyTests-820484470 None] Lock "cinder-quobyte-5716a961-7f66-42c1-9fd0-2c1d062f9ec3" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b1b90784-e810-4385-a4ac-aee9ce509883 tempest-VolumeDependencyTests-820484470 None] Deleting offline snapshot 5716a961-7f66-42c1-9fd0-2c1d062f9ec3 of volume d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:18:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b1b90784-e810-4385-a4ac-aee9ce509883 tempest-VolumeDependencyTests-820484470 None] snapshot_file for this snap is: volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:18:36 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dfd4cb-425a-46ab-8144-b4433e4b3ed5]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b1b90784-e810-4385-a4ac-aee9ce509883 tempest-VolumeDependencyTests-820484470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:36 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3 Sep 25 17:18:36 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:37 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b1b90784-e810-4385-a4ac-aee9ce509883 tempest-VolumeDependencyTests-820484470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3" returned: 0 in 0.772s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b1b90784-e810-4385-a4ac-aee9ce509883 tempest-VolumeDependencyTests-820484470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:18:37 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1243ee8-1ace-4e43-8fcf-e5766c82541e]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b1b90784-e810-4385-a4ac-aee9ce509883 tempest-VolumeDependencyTests-820484470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:37 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 Sep 25 17:18:37 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:38 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b1b90784-e810-4385-a4ac-aee9ce509883 tempest-VolumeDependencyTests-820484470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6" returned: 0 in 1.135s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b1b90784-e810-4385-a4ac-aee9ce509883 tempest-VolumeDependencyTests-820484470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:38 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3 Sep 25 17:18:38 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:39 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b1b90784-e810-4385-a4ac-aee9ce509883 tempest-VolumeDependencyTests-820484470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3" returned: 0 in 0.835s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b1b90784-e810-4385-a4ac-aee9ce509883 tempest-VolumeDependencyTests-820484470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:39 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3 Sep 25 17:18:39 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:39 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b1b90784-e810-4385-a4ac-aee9ce509883 tempest-VolumeDependencyTests-820484470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6.5716a961-7f66-42c1-9fd0-2c1d062f9ec3" returned: 0 in 0.557s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b1b90784-e810-4385-a4ac-aee9ce509883 tempest-VolumeDependencyTests-820484470 None] Lock "cinder-quobyte-5716a961-7f66-42c1-9fd0-2c1d062f9ec3" released by "_delete_snapshot" :: held 3.557s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b1b90784-e810-4385-a4ac-aee9ce509883 tempest-VolumeDependencyTests-820484470 None] Lock "cinder-quobyte-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6" released by "delete_snapshot" :: held 3.589s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:40 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-b1b90784-e810-4385-a4ac-aee9ce509883 tempest-VolumeDependencyTests-820484470 None] Created reservations ['cdb72a73-d5ff-46a4-9eec-4a36d2681698', 'f0bb29c2-a6a1-4afe-8612-cf17143c45ba', '361aa25b-75bf-4d78-9e79-e9bf101be50f', '5fcca75d-725e-4939-9285-820302a74dc1'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:18:40 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b1b90784-e810-4385-a4ac-aee9ce509883 tempest-VolumeDependencyTests-820484470 None] Delete snapshot completed successfully. Sep 25 17:18:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b1b90784-e810-4385-a4ac-aee9ce509883 tempest-VolumeDependencyTests-820484470 None] Lock "cinder-5716a961-7f66-42c1-9fd0-2c1d062f9ec3-delete_snapshot" released by "delete_snapshot" :: held 3.879s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4b9e76f8-5be9-4a22-81b1-4333a8f72fe5 tempest-VolumeDependencyTests-820484470 None] Acquiring lock "cinder-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4b9e76f8-5be9-4a22-81b1-4333a8f72fe5 tempest-VolumeDependencyTests-820484470 None] Lock "cinder-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4b9e76f8-5be9-4a22-81b1-4333a8f72fe5 tempest-VolumeDependencyTests-820484470 None] Acquiring lock "cinder-quobyte-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4b9e76f8-5be9-4a22-81b1-4333a8f72fe5 tempest-VolumeDependencyTests-820484470 None] Lock "cinder-quobyte-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6" acquired by "delete_volume" :: waited 0.041s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:41 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[56767e1b-b05d-4c85-8a2f-10cedf7e7d2a]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4b9e76f8-5be9-4a22-81b1-4333a8f72fe5 tempest-VolumeDependencyTests-820484470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:41 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 Sep 25 17:18:41 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:41 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4b9e76f8-5be9-4a22-81b1-4333a8f72fe5 tempest-VolumeDependencyTests-820484470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6" returned: 0 in 0.658s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4b9e76f8-5be9-4a22-81b1-4333a8f72fe5 tempest-VolumeDependencyTests-820484470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:41 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6 Sep 25 17:18:41 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:42 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4b9e76f8-5be9-4a22-81b1-4333a8f72fe5 tempest-VolumeDependencyTests-820484470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6" returned: 0 in 0.473s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4b9e76f8-5be9-4a22-81b1-4333a8f72fe5 tempest-VolumeDependencyTests-820484470 None] Lock "cinder-quobyte-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6" released by "delete_volume" :: held 1.303s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:42 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-4b9e76f8-5be9-4a22-81b1-4333a8f72fe5 tempest-VolumeDependencyTests-820484470 None] Created reservations ['dda21533-8dfd-4c63-90d2-f754e65a2c11', '638c70e6-8fa7-4c26-9d74-3c17e88a22ca', 'd4af57a3-5f7c-4825-bc94-8eebfd0f5982', '508293da-852e-4d8b-8810-40741d80204f'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:18:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4b9e76f8-5be9-4a22-81b1-4333a8f72fe5 tempest-VolumeDependencyTests-820484470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4b9e76f8-5be9-4a22-81b1-4333a8f72fe5 tempest-VolumeDependencyTests-820484470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4b9e76f8-5be9-4a22-81b1-4333a8f72fe5 tempest-VolumeDependencyTests-820484470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:18:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4b9e76f8-5be9-4a22-81b1-4333a8f72fe5 tempest-VolumeDependencyTests-820484470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:18:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4b9e76f8-5be9-4a22-81b1-4333a8f72fe5 tempest-VolumeDependencyTests-820484470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4b9e76f8-5be9-4a22-81b1-4333a8f72fe5 tempest-VolumeDependencyTests-820484470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:42 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:18:42 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:43 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4b9e76f8-5be9-4a22-81b1-4333a8f72fe5 tempest-VolumeDependencyTests-820484470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.505s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:43 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-4b9e76f8-5be9-4a22-81b1-4333a8f72fe5 tempest-VolumeDependencyTests-820484470 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:18:43 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-4b9e76f8-5be9-4a22-81b1-4333a8f72fe5 tempest-VolumeDependencyTests-820484470 None] Deleted volume successfully. Sep 25 17:18:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4b9e76f8-5be9-4a22-81b1-4333a8f72fe5 tempest-VolumeDependencyTests-820484470 None] Lock "cinder-d60ddfc1-bbe7-4bb8-a905-89e06b5840a6-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fb3f5549-20d5-4628-869a-da2a417906f9 tempest-VolumeDependencyTests-820484470 None] Acquiring lock "cinder-c29d506d-c66d-4f65-9aae-460b668e5476-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fb3f5549-20d5-4628-869a-da2a417906f9 tempest-VolumeDependencyTests-820484470 None] Lock "cinder-c29d506d-c66d-4f65-9aae-460b668e5476-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fb3f5549-20d5-4628-869a-da2a417906f9 tempest-VolumeDependencyTests-820484470 None] Acquiring lock "cinder-quobyte-c29d506d-c66d-4f65-9aae-460b668e5476" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fb3f5549-20d5-4628-869a-da2a417906f9 tempest-VolumeDependencyTests-820484470 None] Lock "cinder-quobyte-c29d506d-c66d-4f65-9aae-460b668e5476" acquired by "delete_volume" :: waited 0.025s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:43 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47c72d8-1f49-4100-94fd-bdae576feadc]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fb3f5549-20d5-4628-869a-da2a417906f9 tempest-VolumeDependencyTests-820484470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c29d506d-c66d-4f65-9aae-460b668e5476 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:44 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c29d506d-c66d-4f65-9aae-460b668e5476 Sep 25 17:18:44 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:44 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fb3f5549-20d5-4628-869a-da2a417906f9 tempest-VolumeDependencyTests-820484470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c29d506d-c66d-4f65-9aae-460b668e5476" returned: 0 in 0.938s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fb3f5549-20d5-4628-869a-da2a417906f9 tempest-VolumeDependencyTests-820484470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c29d506d-c66d-4f65-9aae-460b668e5476 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:44 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c29d506d-c66d-4f65-9aae-460b668e5476 Sep 25 17:18:44 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:45 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ada96275-142e-48b5-bab4-50ca80fcac3e tempest-TestImageHashVerification-1470157824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b /opt/stack/data/cinder/conversion/e998b789-6d68-41af-8b35-2639d4bec31b.temp_image.2cc23df1-3a84-4fb0-96d4-31005c6a6950pj4e_vzh.img" returned: 0 in 9.004s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:45 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[66559dc7-6a35-4d5b-b767-5601aa0716cd]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ada96275-142e-48b5-bab4-50ca80fcac3e tempest-TestImageHashVerification-1470157824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:45 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fb3f5549-20d5-4628-869a-da2a417906f9 tempest-VolumeDependencyTests-820484470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c29d506d-c66d-4f65-9aae-460b668e5476" returned: 0 in 0.459s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fb3f5549-20d5-4628-869a-da2a417906f9 tempest-VolumeDependencyTests-820484470 None] Lock "cinder-quobyte-c29d506d-c66d-4f65-9aae-460b668e5476" released by "delete_volume" :: held 1.518s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:45 devstack sudo[103490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b Sep 25 17:18:45 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:45 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-fb3f5549-20d5-4628-869a-da2a417906f9 tempest-VolumeDependencyTests-820484470 None] Created reservations ['bdf05c5f-232a-481a-9192-b4bafb38333a', 'd70adea6-3d1f-4fbc-8fb9-43467660ffcb', '72a7252d-b9ec-4d83-bbe7-487bf8b33746', '2560af1b-9c3d-4d21-9409-917fbb50507d'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:18:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-fb3f5549-20d5-4628-869a-da2a417906f9 tempest-VolumeDependencyTests-820484470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-fb3f5549-20d5-4628-869a-da2a417906f9 tempest-VolumeDependencyTests-820484470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-fb3f5549-20d5-4628-869a-da2a417906f9 tempest-VolumeDependencyTests-820484470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:18:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-fb3f5549-20d5-4628-869a-da2a417906f9 tempest-VolumeDependencyTests-820484470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:18:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-fb3f5549-20d5-4628-869a-da2a417906f9 tempest-VolumeDependencyTests-820484470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fb3f5549-20d5-4628-869a-da2a417906f9 tempest-VolumeDependencyTests-820484470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:45 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:18:45 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:45 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fb3f5549-20d5-4628-869a-da2a417906f9 tempest-VolumeDependencyTests-820484470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.407s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:45 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-fb3f5549-20d5-4628-869a-da2a417906f9 tempest-VolumeDependencyTests-820484470 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:18:45 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-fb3f5549-20d5-4628-869a-da2a417906f9 tempest-VolumeDependencyTests-820484470 None] Deleted volume successfully. Sep 25 17:18:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fb3f5549-20d5-4628-869a-da2a417906f9 tempest-VolumeDependencyTests-820484470 None] Lock "cinder-c29d506d-c66d-4f65-9aae-460b668e5476-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:45 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:18:45 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Flow 'volume_create_manager' (f4994e9f-c623-49b4-a55c-efd4e1de7e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:18:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc78ea1a-e4ea-4cc4-9a33-032fcfcda764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ada96275-142e-48b5-bab4-50ca80fcac3e tempest-TestImageHashVerification-1470157824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b" returned: 0 in 0.922s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:46 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-ada96275-142e-48b5-bab4-50ca80fcac3e tempest-TestImageHashVerification-1470157824 None] Image conversion details: src /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b, size 1024.00 MB, duration 9.00 sec, destination /opt/stack/data/cinder/conversion/e998b789-6d68-41af-8b35-2639d4bec31b.temp_image.2cc23df1-3a84-4fb0-96d4-31005c6a6950pj4e_vzh.img {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:18:46 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-ada96275-142e-48b5-bab4-50ca80fcac3e tempest-TestImageHashVerification-1470157824 None] Converted 1024.00 MB image at 113.72 MB/s Sep 25 17:18:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc78ea1a-e4ea-4cc4-9a33-032fcfcda764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-770679441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e59b3ba2-cddd-4fe9-a0a5-efe1a1052458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21821c18dbd74ccfa665bdd556a6c361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:46Z,use_quota=True,user_id='573b5cfbef0c4d428fed101986497bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44fd043-e7eb-45fa-9008-ea8d1de4f558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44fd043-e7eb-45fa-9008-ea8d1de4f558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a61196-291e-4fec-af6c-55cb34eb5b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a61196-291e-4fec-af6c-55cb34eb5b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e59b3ba2-cddd-4fe9-a0a5-efe1a1052458', 'volume_name': 'volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6e0634-40f1-4088-9efe-c6f8d420e4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6e0634-40f1-4088-9efe-c6f8d420e4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376cbdee-db17-4fa2-85de-36151f62191c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:46 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Volume e59b3ba2-cddd-4fe9-a0a5-efe1a1052458: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458', 'volume_size': 1} Sep 25 17:18:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:46 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-ada96275-142e-48b5-bab4-50ca80fcac3e tempest-TestImageHashVerification-1470157824 None] 2cc23df1-3a84-4fb0-96d4-31005c6a6950 was raw, no need to convert to raw {{(pid=87211) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 17:18:49 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-ccd53a72-df4f-4361-b10e-ce609e5f47c1 req-4e2aa172-7ef7-4a3f-bae4-99ed5b558893 tempest-TestShelveInstance-1770032521 None] Terminate volume connection completed successfully. Sep 25 17:18:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-ccd53a72-df4f-4361-b10e-ce609e5f47c1 req-4e2aa172-7ef7-4a3f-bae4-99ed5b558893 tempest-TestShelveInstance-1770032521 None] Deleting attachment 62e2971a-a67e-4c27-b949-80f752705b4a. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:18:50 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:18:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Flow 'volume_create_manager' (1a0e75b2-ef9c-4491-8110-eb787caf0edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:18:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126085b8-e2e0-476e-ae17-56e8bf9348f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126085b8-e2e0-476e-ae17-56e8bf9348f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a92eb71-f98c-4486-9629-92a07ed7dd43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2d4ba2bbb248f7bb15c55069fc8993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:51Z,use_quota=True,user_id='131e3fe1990f4072bf2fd8d9ab296034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da716cf1-516e-4b7e-8010-de16ea9dc851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da716cf1-516e-4b7e-8010-de16ea9dc851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04244f1-29d3-43e6-a533-c6dacad34a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04244f1-29d3-43e6-a533-c6dacad34a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a92eb71-f98c-4486-9629-92a07ed7dd43', 'volume_name': 'volume-6a92eb71-f98c-4486-9629-92a07ed7dd43', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d4256c-1a55-4e9e-9dc8-6bfa9121e4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d4256c-1a55-4e9e-9dc8-6bfa9121e4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06ee288-3c1c-4daf-9e36-76e377982c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:50 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Volume 6a92eb71-f98c-4486-9629-92a07ed7dd43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a92eb71-f98c-4486-9629-92a07ed7dd43', 'volume_size': 1} Sep 25 17:18:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-1d95b26a-b497-49d2-b26c-6fd9de812364 req-56c63490-79a2-4c34-90ee-56a87a4ec4e6 tempest-TestShelveInstance-1770032521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:18:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:18:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:18:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:53 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:18:53 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:54 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.387s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:54 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:18:54 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:18:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 28 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:18:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:19:02 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=47,cinder:INSERT=18,cinder:UPDATE=55,cinder:DELETE=3 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:19:02 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:UPDATE=58,cinder:SELECT=46,cinder:DELETE=6,cinder:INSERT=10 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:19:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ada96275-142e-48b5-bab4-50ca80fcac3e tempest-TestImageHashVerification-1470157824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.454s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-ada96275-142e-48b5-bab4-50ca80fcac3e tempest-TestImageHashVerification-1470157824 None] Uploaded volume to glance image-id: 2cc23df1-3a84-4fb0-96d4-31005c6a6950. {{(pid=87211) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 17:19:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.533s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-770679441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e59b3ba2-cddd-4fe9-a0a5-efe1a1052458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21821c18dbd74ccfa665bdd556a6c361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:46Z,use_quota=True,user_id='573b5cfbef0c4d428fed101986497bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:19:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Creating volume e59b3ba2-cddd-4fe9-a0a5-efe1a1052458 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:19:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:19:06 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:19:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:06 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458 1073741824 Sep 25 17:19:06 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:06 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-ada96275-142e-48b5-bab4-50ca80fcac3e tempest-TestImageHashVerification-1470157824 None] Copy volume to image completed successfully. Sep 25 17:19:07 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458 1073741824" returned: 0 in 0.502s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:07 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458 Sep 25 17:19:07 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0988c58f-f5f1-4ea8-b23d-cf9769efee43 tempest-TestImageHashVerification-1470157824 None] Acquiring lock "cinder-e998b789-6d68-41af-8b35-2639d4bec31b-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:07 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458" returned: 0 in 0.283s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.610s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a92eb71-f98c-4486-9629-92a07ed7dd43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2d4ba2bbb248f7bb15c55069fc8993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:51Z,use_quota=True,user_id='131e3fe1990f4072bf2fd8d9ab296034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Creating volume 6a92eb71-f98c-4486-9629-92a07ed7dd43 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:19:07 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6a92eb71-f98c-4486-9629-92a07ed7dd43 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0988c58f-f5f1-4ea8-b23d-cf9769efee43 tempest-TestImageHashVerification-1470157824 None] Lock "cinder-e998b789-6d68-41af-8b35-2639d4bec31b-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:07 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6a92eb71-f98c-4486-9629-92a07ed7dd43 1073741824 Sep 25 17:19:07 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376cbdee-db17-4fa2-85de-36151f62191c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfa9aaa-ec06-4787-91e8-73aae38e4752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:07 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Volume volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458 (e59b3ba2-cddd-4fe9-a0a5-efe1a1052458): created successfully Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfa9aaa-ec06-4787-91e8-73aae38e4752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Flow 'volume_create_manager' (f4994e9f-c623-49b4-a55c-efd4e1de7e94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0988c58f-f5f1-4ea8-b23d-cf9769efee43 tempest-TestImageHashVerification-1470157824 None] Acquiring lock "cinder-quobyte-e998b789-6d68-41af-8b35-2639d4bec31b" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:07 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-0ff4b7c1-8afb-4a1c-b93c-f3b29611ff93 req-b330a685-37d7-4335-a10d-5dc14401220a tempest-VolumesSnapshotsTestJSON-1243812076 None] Created volume successfully. Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0988c58f-f5f1-4ea8-b23d-cf9769efee43 tempest-TestImageHashVerification-1470157824 None] Lock "cinder-quobyte-e998b789-6d68-41af-8b35-2639d4bec31b" acquired by "delete_volume" :: waited 0.024s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9d2a02-66fe-45ad-97a5-c5b7429935ca]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0988c58f-f5f1-4ea8-b23d-cf9769efee43 tempest-TestImageHashVerification-1470157824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:07 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b Sep 25 17:19:07 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:07 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6a92eb71-f98c-4486-9629-92a07ed7dd43 1073741824" returned: 0 in 0.506s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6a92eb71-f98c-4486-9629-92a07ed7dd43 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:08 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6a92eb71-f98c-4486-9629-92a07ed7dd43 Sep 25 17:19:08 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:08 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0988c58f-f5f1-4ea8-b23d-cf9769efee43 tempest-TestImageHashVerification-1470157824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b" returned: 0 in 0.433s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0988c58f-f5f1-4ea8-b23d-cf9769efee43 tempest-TestImageHashVerification-1470157824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:08 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b Sep 25 17:19:08 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:08 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6a92eb71-f98c-4486-9629-92a07ed7dd43" returned: 0 in 0.275s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-1d95b26a-b497-49d2-b26c-6fd9de812364 req-56c63490-79a2-4c34-90ee-56a87a4ec4e6 tempest-TestShelveInstance-1770032521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.595s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06ee288-3c1c-4daf-9e36-76e377982c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a92eb71-f98c-4486-9629-92a07ed7dd43', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (586f4b83-34e8-4575-9811-829a54a9738a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-1d95b26a-b497-49d2-b26c-6fd9de812364 req-56c63490-79a2-4c34-90ee-56a87a4ec4e6 tempest-TestShelveInstance-1770032521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:08 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Volume volume-6a92eb71-f98c-4486-9629-92a07ed7dd43 (6a92eb71-f98c-4486-9629-92a07ed7dd43): created successfully Sep 25 17:19:08 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (586f4b83-34e8-4575-9811-829a54a9738a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Flow 'volume_create_manager' (1a0e75b2-ef9c-4491-8110-eb787caf0edb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0988c58f-f5f1-4ea8-b23d-cf9769efee43 tempest-TestImageHashVerification-1470157824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e998b789-6d68-41af-8b35-2639d4bec31b" returned: 0 in 0.299s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0988c58f-f5f1-4ea8-b23d-cf9769efee43 tempest-TestImageHashVerification-1470157824 None] Lock "cinder-quobyte-e998b789-6d68-41af-8b35-2639d4bec31b" released by "delete_volume" :: held 0.806s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:08 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-c1324dea-c38f-4edd-81fd-ee367d556975 tempest-CinderUnicodeTest-373386968 None] Created volume successfully. Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-1d95b26a-b497-49d2-b26c-6fd9de812364 req-56c63490-79a2-4c34-90ee-56a87a4ec4e6 tempest-TestShelveInstance-1770032521 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-b43776fd-5ab3-457f-9c2f-bff450785044', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d8025a5-b7f5-4d5e-bfb5-244769321b25', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-96c6a3ad-5177-4e32-b9e1-30a64cb9034d req-fe4f2c1b-1fe6-4777-abd7-1ea2abf6a942 tempest-VolumesSnapshotsTestJSON-1243812076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-96c6a3ad-5177-4e32-b9e1-30a64cb9034d req-fe4f2c1b-1fe6-4777-abd7-1ea2abf6a942 tempest-VolumesSnapshotsTestJSON-1243812076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [req-96c6a3ad-5177-4e32-b9e1-30a64cb9034d req-fe4f2c1b-1fe6-4777-abd7-1ea2abf6a942 tempest-VolumesSnapshotsTestJSON-1243812076 None] Creating offline snapshot 3555fd89-d9f0-44c0-9901-22d7b14f7367 of volume e59b3ba2-cddd-4fe9-a0a5-efe1a1052458 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf25c27-48ac-4d7c-865f-8724a4647c2f]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-96c6a3ad-5177-4e32-b9e1-30a64cb9034d req-fe4f2c1b-1fe6-4777-abd7-1ea2abf6a942 tempest-VolumesSnapshotsTestJSON-1243812076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:08 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-1d95b26a-b497-49d2-b26c-6fd9de812364 req-56c63490-79a2-4c34-90ee-56a87a4ec4e6 tempest-TestShelveInstance-1770032521 None] attachment_update completed successfully. Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-0988c58f-f5f1-4ea8-b23d-cf9769efee43 tempest-TestImageHashVerification-1470157824 None] Created reservations ['6bc2571e-ec96-479f-b889-f76a926a894b', '968ad2c6-07c2-42a6-b9a5-bf3590a26a89', '878b8ba9-b018-4019-831d-4c8eb7e11d7d', '2fd6ebbf-893e-42ac-aa14-f207d4929572'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:08 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458 Sep 25 17:19:08 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0988c58f-f5f1-4ea8-b23d-cf9769efee43 tempest-TestImageHashVerification-1470157824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0988c58f-f5f1-4ea8-b23d-cf9769efee43 tempest-TestImageHashVerification-1470157824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0988c58f-f5f1-4ea8-b23d-cf9769efee43 tempest-TestImageHashVerification-1470157824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0988c58f-f5f1-4ea8-b23d-cf9769efee43 tempest-TestImageHashVerification-1470157824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0988c58f-f5f1-4ea8-b23d-cf9769efee43 tempest-TestImageHashVerification-1470157824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0988c58f-f5f1-4ea8-b23d-cf9769efee43 tempest-TestImageHashVerification-1470157824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:08 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:19:08 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:09 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-96c6a3ad-5177-4e32-b9e1-30a64cb9034d req-fe4f2c1b-1fe6-4777-abd7-1ea2abf6a942 tempest-VolumesSnapshotsTestJSON-1243812076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458" returned: 0 in 0.510s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-96c6a3ad-5177-4e32-b9e1-30a64cb9034d req-fe4f2c1b-1fe6-4777-abd7-1ea2abf6a942 tempest-VolumesSnapshotsTestJSON-1243812076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.3555fd89-d9f0-44c0-9901-22d7b14f7367 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:09 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0988c58f-f5f1-4ea8-b23d-cf9769efee43 tempest-TestImageHashVerification-1470157824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.377s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:09 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-0988c58f-f5f1-4ea8-b23d-cf9769efee43 tempest-TestImageHashVerification-1470157824 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:09 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-0988c58f-f5f1-4ea8-b23d-cf9769efee43 tempest-TestImageHashVerification-1470157824 None] Deleted volume successfully. Sep 25 17:19:09 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.3555fd89-d9f0-44c0-9901-22d7b14f7367 1G Sep 25 17:19:09 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:09 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0988c58f-f5f1-4ea8-b23d-cf9769efee43 tempest-TestImageHashVerification-1470157824 None] Lock "cinder-e998b789-6d68-41af-8b35-2639d4bec31b-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:09 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-96c6a3ad-5177-4e32-b9e1-30a64cb9034d req-fe4f2c1b-1fe6-4777-abd7-1ea2abf6a942 tempest-VolumesSnapshotsTestJSON-1243812076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.3555fd89-d9f0-44c0-9901-22d7b14f7367 1G" returned: 0 in 0.580s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-96c6a3ad-5177-4e32-b9e1-30a64cb9034d req-fe4f2c1b-1fe6-4777-abd7-1ea2abf6a942 tempest-VolumesSnapshotsTestJSON-1243812076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.3555fd89-d9f0-44c0-9901-22d7b14f7367 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:09 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.3555fd89-d9f0-44c0-9901-22d7b14f7367 Sep 25 17:19:09 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:09 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:19:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Flow 'volume_create_manager' (f312eeec-f9cd-44e5-bf93-18734ceb4599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8970ef4f-ff13-44e2-8b1b-7c73550a8a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8970ef4f-ff13-44e2-8b1b-7c73550a8a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-658271177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c6f1fe-897f-4937-8ab1-d99f552e27d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2d4ba2bbb248f7bb15c55069fc8993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:10Z,use_quota=True,user_id='131e3fe1990f4072bf2fd8d9ab296034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f66165-8053-4aeb-9a08-2f1ad1d511b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f66165-8053-4aeb-9a08-2f1ad1d511b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6fd1454-7f2c-4fb5-9743-062a2895402f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6fd1454-7f2c-4fb5-9743-062a2895402f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78c6f1fe-897f-4937-8ab1-d99f552e27d7', 'volume_name': 'volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c7a3ed-d4a4-4d6a-b4ce-84f7cbbf6041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c7a3ed-d4a4-4d6a-b4ce-84f7cbbf6041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96fbf9b-ce24-4ef0-8753-2ee54918be8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:09 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Volume 78c6f1fe-897f-4937-8ab1-d99f552e27d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7', 'volume_size': 1} Sep 25 17:19:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:09 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-96c6a3ad-5177-4e32-b9e1-30a64cb9034d req-fe4f2c1b-1fe6-4777-abd7-1ea2abf6a942 tempest-VolumesSnapshotsTestJSON-1243812076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.3555fd89-d9f0-44c0-9901-22d7b14f7367" returned: 0 in 0.314s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:09 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [req-96c6a3ad-5177-4e32-b9e1-30a64cb9034d req-fe4f2c1b-1fe6-4777-abd7-1ea2abf6a942 tempest-VolumesSnapshotsTestJSON-1243812076 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.3555fd89-d9f0-44c0-9901-22d7b14f7367 is being set with open permissions: ugo+rw Sep 25 17:19:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-96c6a3ad-5177-4e32-b9e1-30a64cb9034d req-fe4f2c1b-1fe6-4777-abd7-1ea2abf6a942 tempest-VolumesSnapshotsTestJSON-1243812076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.3555fd89-d9f0-44c0-9901-22d7b14f7367 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:10 devstack sudo[103601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.3555fd89-d9f0-44c0-9901-22d7b14f7367 Sep 25 17:19:10 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:10 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-96c6a3ad-5177-4e32-b9e1-30a64cb9034d req-fe4f2c1b-1fe6-4777-abd7-1ea2abf6a942 tempest-VolumesSnapshotsTestJSON-1243812076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.3555fd89-d9f0-44c0-9901-22d7b14f7367" returned: 0 in 0.310s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-96c6a3ad-5177-4e32-b9e1-30a64cb9034d req-fe4f2c1b-1fe6-4777-abd7-1ea2abf6a942 tempest-VolumesSnapshotsTestJSON-1243812076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:10 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.info Sep 25 17:19:10 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:10 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-96c6a3ad-5177-4e32-b9e1-30a64cb9034d req-fe4f2c1b-1fe6-4777-abd7-1ea2abf6a942 tempest-VolumesSnapshotsTestJSON-1243812076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.info" returned: 0 in 0.316s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:10 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [req-96c6a3ad-5177-4e32-b9e1-30a64cb9034d req-fe4f2c1b-1fe6-4777-abd7-1ea2abf6a942 tempest-VolumesSnapshotsTestJSON-1243812076 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.info is being set with open permissions: ugo+rw Sep 25 17:19:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-96c6a3ad-5177-4e32-b9e1-30a64cb9034d req-fe4f2c1b-1fe6-4777-abd7-1ea2abf6a942 tempest-VolumesSnapshotsTestJSON-1243812076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:10 devstack sudo[103608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.info Sep 25 17:19:10 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:10 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-96c6a3ad-5177-4e32-b9e1-30a64cb9034d req-fe4f2c1b-1fe6-4777-abd7-1ea2abf6a942 tempest-VolumesSnapshotsTestJSON-1243812076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.info" returned: 0 in 0.320s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-96c6a3ad-5177-4e32-b9e1-30a64cb9034d req-fe4f2c1b-1fe6-4777-abd7-1ea2abf6a942 tempest-VolumesSnapshotsTestJSON-1243812076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.478s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.122s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-658271177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c6f1fe-897f-4937-8ab1-d99f552e27d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2d4ba2bbb248f7bb15c55069fc8993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:10Z,use_quota=True,user_id='131e3fe1990f4072bf2fd8d9ab296034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:19:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Creating volume 78c6f1fe-897f-4937-8ab1-d99f552e27d7 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:19:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:19:11 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:19:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:11 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7 1073741824 Sep 25 17:19:11 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:11 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-96c6a3ad-5177-4e32-b9e1-30a64cb9034d req-fe4f2c1b-1fe6-4777-abd7-1ea2abf6a942 tempest-VolumesSnapshotsTestJSON-1243812076 None] Create snapshot completed successfully Sep 25 17:19:11 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7 1073741824" returned: 0 in 0.572s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:11 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7 Sep 25 17:19:11 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:12 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7" returned: 0 in 0.411s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:19:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96fbf9b-ce24-4ef0-8753-2ee54918be8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a603dc-4093-43e1-928e-43037403ea2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-b990b8b5-26a9-4b45-bfd4-8f2a7343618e req-929f0f07-fdb8-4e51-9527-59714d9db1c8 tempest-VolumesSnapshotsTestJSON-1243812076 None] Acquiring lock "cinder-3555fd89-d9f0-44c0-9901-22d7b14f7367-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:12 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Volume volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7 (78c6f1fe-897f-4937-8ab1-d99f552e27d7): created successfully Sep 25 17:19:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a603dc-4093-43e1-928e-43037403ea2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Flow 'volume_create_manager' (f312eeec-f9cd-44e5-bf93-18734ceb4599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-b990b8b5-26a9-4b45-bfd4-8f2a7343618e req-929f0f07-fdb8-4e51-9527-59714d9db1c8 tempest-VolumesSnapshotsTestJSON-1243812076 None] Lock "cinder-3555fd89-d9f0-44c0-9901-22d7b14f7367-delete_snapshot" acquired by "delete_snapshot" :: waited 0.120s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-b990b8b5-26a9-4b45-bfd4-8f2a7343618e req-929f0f07-fdb8-4e51-9527-59714d9db1c8 tempest-VolumesSnapshotsTestJSON-1243812076 None] Acquiring lock "cinder-quobyte-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:12 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-43f4a64e-756e-40a3-b16e-275c1dab0b43 tempest-CinderUnicodeTest-373386968 None] Created volume successfully. Sep 25 17:19:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-b990b8b5-26a9-4b45-bfd4-8f2a7343618e req-929f0f07-fdb8-4e51-9527-59714d9db1c8 tempest-VolumesSnapshotsTestJSON-1243812076 None] Lock "cinder-quobyte-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458" acquired by "delete_snapshot" :: waited 0.076s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-b990b8b5-26a9-4b45-bfd4-8f2a7343618e req-929f0f07-fdb8-4e51-9527-59714d9db1c8 tempest-VolumesSnapshotsTestJSON-1243812076 None] Acquiring lock "cinder-quobyte-3555fd89-d9f0-44c0-9901-22d7b14f7367" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-b990b8b5-26a9-4b45-bfd4-8f2a7343618e req-929f0f07-fdb8-4e51-9527-59714d9db1c8 tempest-VolumesSnapshotsTestJSON-1243812076 None] Lock "cinder-quobyte-3555fd89-d9f0-44c0-9901-22d7b14f7367" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [req-b990b8b5-26a9-4b45-bfd4-8f2a7343618e req-929f0f07-fdb8-4e51-9527-59714d9db1c8 tempest-VolumesSnapshotsTestJSON-1243812076 None] Deleting offline snapshot 3555fd89-d9f0-44c0-9901-22d7b14f7367 of volume e59b3ba2-cddd-4fe9-a0a5-efe1a1052458 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:19:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [req-b990b8b5-26a9-4b45-bfd4-8f2a7343618e req-929f0f07-fdb8-4e51-9527-59714d9db1c8 tempest-VolumesSnapshotsTestJSON-1243812076 None] snapshot_file for this snap is: volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.3555fd89-d9f0-44c0-9901-22d7b14f7367 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:19:12 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[82392012-a648-496e-9fcb-3c14f34cd112]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-b990b8b5-26a9-4b45-bfd4-8f2a7343618e req-929f0f07-fdb8-4e51-9527-59714d9db1c8 tempest-VolumesSnapshotsTestJSON-1243812076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.3555fd89-d9f0-44c0-9901-22d7b14f7367 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:12 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.3555fd89-d9f0-44c0-9901-22d7b14f7367 Sep 25 17:19:12 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:13 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-b990b8b5-26a9-4b45-bfd4-8f2a7343618e req-929f0f07-fdb8-4e51-9527-59714d9db1c8 tempest-VolumesSnapshotsTestJSON-1243812076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.3555fd89-d9f0-44c0-9901-22d7b14f7367" returned: 0 in 0.565s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [req-b990b8b5-26a9-4b45-bfd4-8f2a7343618e req-929f0f07-fdb8-4e51-9527-59714d9db1c8 tempest-VolumesSnapshotsTestJSON-1243812076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:19:13 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a1f185-3333-4849-b87e-63c20edae006]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-b990b8b5-26a9-4b45-bfd4-8f2a7343618e req-929f0f07-fdb8-4e51-9527-59714d9db1c8 tempest-VolumesSnapshotsTestJSON-1243812076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:13 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458 Sep 25 17:19:13 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-adcc3883-ba0f-43e8-ac13-710a2d93bf69 tempest-CinderUnicodeTest-373386968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-adcc3883-ba0f-43e8-ac13-710a2d93bf69 tempest-CinderUnicodeTest-373386968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-adcc3883-ba0f-43e8-ac13-710a2d93bf69 tempest-CinderUnicodeTest-373386968 None] Creating offline snapshot 414c581b-ca92-4cd3-8074-9301c9dabf4a of volume 78c6f1fe-897f-4937-8ab1-d99f552e27d7 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:19:13 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ceecd95-8f33-4e30-8c7c-777678bf67c9]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-adcc3883-ba0f-43e8-ac13-710a2d93bf69 tempest-CinderUnicodeTest-373386968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:13 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7 Sep 25 17:19:13 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:13 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-b990b8b5-26a9-4b45-bfd4-8f2a7343618e req-929f0f07-fdb8-4e51-9527-59714d9db1c8 tempest-VolumesSnapshotsTestJSON-1243812076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458" returned: 0 in 0.653s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-b990b8b5-26a9-4b45-bfd4-8f2a7343618e req-929f0f07-fdb8-4e51-9527-59714d9db1c8 tempest-VolumesSnapshotsTestJSON-1243812076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.3555fd89-d9f0-44c0-9901-22d7b14f7367 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:13 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.3555fd89-d9f0-44c0-9901-22d7b14f7367 Sep 25 17:19:13 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:14 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-adcc3883-ba0f-43e8-ac13-710a2d93bf69 tempest-CinderUnicodeTest-373386968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7" returned: 0 in 0.466s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-adcc3883-ba0f-43e8-ac13-710a2d93bf69 tempest-CinderUnicodeTest-373386968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.414c581b-ca92-4cd3-8074-9301c9dabf4a 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:14 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.414c581b-ca92-4cd3-8074-9301c9dabf4a 1G Sep 25 17:19:14 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:14 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-b990b8b5-26a9-4b45-bfd4-8f2a7343618e req-929f0f07-fdb8-4e51-9527-59714d9db1c8 tempest-VolumesSnapshotsTestJSON-1243812076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.3555fd89-d9f0-44c0-9901-22d7b14f7367" returned: 0 in 0.426s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-b990b8b5-26a9-4b45-bfd4-8f2a7343618e req-929f0f07-fdb8-4e51-9527-59714d9db1c8 tempest-VolumesSnapshotsTestJSON-1243812076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.3555fd89-d9f0-44c0-9901-22d7b14f7367 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:14 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.3555fd89-d9f0-44c0-9901-22d7b14f7367 Sep 25 17:19:14 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:14 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-b990b8b5-26a9-4b45-bfd4-8f2a7343618e req-929f0f07-fdb8-4e51-9527-59714d9db1c8 tempest-VolumesSnapshotsTestJSON-1243812076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458.3555fd89-d9f0-44c0-9901-22d7b14f7367" returned: 0 in 0.347s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:14 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-adcc3883-ba0f-43e8-ac13-710a2d93bf69 tempest-CinderUnicodeTest-373386968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.414c581b-ca92-4cd3-8074-9301c9dabf4a 1G" returned: 0 in 0.564s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-adcc3883-ba0f-43e8-ac13-710a2d93bf69 tempest-CinderUnicodeTest-373386968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.414c581b-ca92-4cd3-8074-9301c9dabf4a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:14 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.414c581b-ca92-4cd3-8074-9301c9dabf4a Sep 25 17:19:14 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:14 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-b990b8b5-26a9-4b45-bfd4-8f2a7343618e req-929f0f07-fdb8-4e51-9527-59714d9db1c8 tempest-VolumesSnapshotsTestJSON-1243812076 None] Lock "cinder-quobyte-3555fd89-d9f0-44c0-9901-22d7b14f7367" released by "_delete_snapshot" :: held 2.238s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:14 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-b990b8b5-26a9-4b45-bfd4-8f2a7343618e req-929f0f07-fdb8-4e51-9527-59714d9db1c8 tempest-VolumesSnapshotsTestJSON-1243812076 None] Lock "cinder-quobyte-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458" released by "delete_snapshot" :: held 2.292s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:14 devstack cinder-volume[87211]: DEBUG cinder.quota [req-b990b8b5-26a9-4b45-bfd4-8f2a7343618e req-929f0f07-fdb8-4e51-9527-59714d9db1c8 tempest-VolumesSnapshotsTestJSON-1243812076 None] Created reservations ['2a7964c7-7187-4a57-9c0f-bb69ecd16e84', '2aec4270-49e0-48f6-b8b8-b519a5d2f07a', '0db61970-5f3f-4f98-8067-98c056cad51f', '07e4d5ae-c1b7-4d4a-928f-393f5ce4c0c0'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:14 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-b990b8b5-26a9-4b45-bfd4-8f2a7343618e req-929f0f07-fdb8-4e51-9527-59714d9db1c8 tempest-VolumesSnapshotsTestJSON-1243812076 None] Delete snapshot completed successfully. Sep 25 17:19:14 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-b990b8b5-26a9-4b45-bfd4-8f2a7343618e req-929f0f07-fdb8-4e51-9527-59714d9db1c8 tempest-VolumesSnapshotsTestJSON-1243812076 None] Lock "cinder-3555fd89-d9f0-44c0-9901-22d7b14f7367-delete_snapshot" released by "delete_snapshot" :: held 2.659s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:15 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-adcc3883-ba0f-43e8-ac13-710a2d93bf69 tempest-CinderUnicodeTest-373386968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.414c581b-ca92-4cd3-8074-9301c9dabf4a" returned: 0 in 0.473s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:15 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-adcc3883-ba0f-43e8-ac13-710a2d93bf69 tempest-CinderUnicodeTest-373386968 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.414c581b-ca92-4cd3-8074-9301c9dabf4a is being set with open permissions: ugo+rw Sep 25 17:19:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-adcc3883-ba0f-43e8-ac13-710a2d93bf69 tempest-CinderUnicodeTest-373386968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.414c581b-ca92-4cd3-8074-9301c9dabf4a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:15 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.414c581b-ca92-4cd3-8074-9301c9dabf4a Sep 25 17:19:15 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:15 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-adcc3883-ba0f-43e8-ac13-710a2d93bf69 tempest-CinderUnicodeTest-373386968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.414c581b-ca92-4cd3-8074-9301c9dabf4a" returned: 0 in 0.439s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-adcc3883-ba0f-43e8-ac13-710a2d93bf69 tempest-CinderUnicodeTest-373386968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:15 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.info Sep 25 17:19:15 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:15 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-bb06dd65-62d0-4e5d-882b-4e5ee628e9dc req-65605795-38c5-402f-98b7-700e64e7efcf tempest-VolumesSnapshotsTestJSON-1243812076 None] Acquiring lock "cinder-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:15 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-bb06dd65-62d0-4e5d-882b-4e5ee628e9dc req-65605795-38c5-402f-98b7-700e64e7efcf tempest-VolumesSnapshotsTestJSON-1243812076 None] Lock "cinder-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:15 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-bb06dd65-62d0-4e5d-882b-4e5ee628e9dc req-65605795-38c5-402f-98b7-700e64e7efcf tempest-VolumesSnapshotsTestJSON-1243812076 None] Acquiring lock "cinder-quobyte-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:15 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-bb06dd65-62d0-4e5d-882b-4e5ee628e9dc req-65605795-38c5-402f-98b7-700e64e7efcf tempest-VolumesSnapshotsTestJSON-1243812076 None] Lock "cinder-quobyte-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458" acquired by "delete_volume" :: waited 0.024s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:16 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-adcc3883-ba0f-43e8-ac13-710a2d93bf69 tempest-CinderUnicodeTest-373386968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.info" returned: 0 in 0.481s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:16 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-adcc3883-ba0f-43e8-ac13-710a2d93bf69 tempest-CinderUnicodeTest-373386968 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.info is being set with open permissions: ugo+rw Sep 25 17:19:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-adcc3883-ba0f-43e8-ac13-710a2d93bf69 tempest-CinderUnicodeTest-373386968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:16 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa82f79e-02a8-4861-8841-b3ae77562d7c]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-bb06dd65-62d0-4e5d-882b-4e5ee628e9dc req-65605795-38c5-402f-98b7-700e64e7efcf tempest-VolumesSnapshotsTestJSON-1243812076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:16 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.info Sep 25 17:19:16 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:16 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458 Sep 25 17:19:16 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:16 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-adcc3883-ba0f-43e8-ac13-710a2d93bf69 tempest-CinderUnicodeTest-373386968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.info" returned: 0 in 0.391s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-adcc3883-ba0f-43e8-ac13-710a2d93bf69 tempest-CinderUnicodeTest-373386968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.019s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:16 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-adcc3883-ba0f-43e8-ac13-710a2d93bf69 tempest-CinderUnicodeTest-373386968 None] Create snapshot completed successfully Sep 25 17:19:16 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-bb06dd65-62d0-4e5d-882b-4e5ee628e9dc req-65605795-38c5-402f-98b7-700e64e7efcf tempest-VolumesSnapshotsTestJSON-1243812076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458" returned: 0 in 0.584s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-bb06dd65-62d0-4e5d-882b-4e5ee628e9dc req-65605795-38c5-402f-98b7-700e64e7efcf tempest-VolumesSnapshotsTestJSON-1243812076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:16 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458 Sep 25 17:19:16 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:17 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-bb06dd65-62d0-4e5d-882b-4e5ee628e9dc req-65605795-38c5-402f-98b7-700e64e7efcf tempest-VolumesSnapshotsTestJSON-1243812076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458" returned: 0 in 0.344s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-bb06dd65-62d0-4e5d-882b-4e5ee628e9dc req-65605795-38c5-402f-98b7-700e64e7efcf tempest-VolumesSnapshotsTestJSON-1243812076 None] Lock "cinder-quobyte-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458" released by "delete_volume" :: held 1.058s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:17 devstack cinder-volume[87211]: DEBUG cinder.quota [req-bb06dd65-62d0-4e5d-882b-4e5ee628e9dc req-65605795-38c5-402f-98b7-700e64e7efcf tempest-VolumesSnapshotsTestJSON-1243812076 None] Created reservations ['4ee58c8f-946c-4a02-8459-1f1655dc3622', 'e7351013-6c4e-4ddf-a65d-18ab02cafb12', 'f9207866-0199-4cd8-b805-ef706818d517', '8c026f9e-f7a1-4f97-b970-8eeddd0fe653'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-bb06dd65-62d0-4e5d-882b-4e5ee628e9dc req-65605795-38c5-402f-98b7-700e64e7efcf tempest-VolumesSnapshotsTestJSON-1243812076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-bb06dd65-62d0-4e5d-882b-4e5ee628e9dc req-65605795-38c5-402f-98b7-700e64e7efcf tempest-VolumesSnapshotsTestJSON-1243812076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [req-bb06dd65-62d0-4e5d-882b-4e5ee628e9dc req-65605795-38c5-402f-98b7-700e64e7efcf tempest-VolumesSnapshotsTestJSON-1243812076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [req-bb06dd65-62d0-4e5d-882b-4e5ee628e9dc req-65605795-38c5-402f-98b7-700e64e7efcf tempest-VolumesSnapshotsTestJSON-1243812076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-bb06dd65-62d0-4e5d-882b-4e5ee628e9dc req-65605795-38c5-402f-98b7-700e64e7efcf tempest-VolumesSnapshotsTestJSON-1243812076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-bb06dd65-62d0-4e5d-882b-4e5ee628e9dc req-65605795-38c5-402f-98b7-700e64e7efcf tempest-VolumesSnapshotsTestJSON-1243812076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:17 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:19:17 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:17 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-bb06dd65-62d0-4e5d-882b-4e5ee628e9dc req-65605795-38c5-402f-98b7-700e64e7efcf tempest-VolumesSnapshotsTestJSON-1243812076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.367s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:17 devstack cinder-volume[87211]: DEBUG cinder.manager [req-bb06dd65-62d0-4e5d-882b-4e5ee628e9dc req-65605795-38c5-402f-98b7-700e64e7efcf tempest-VolumesSnapshotsTestJSON-1243812076 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-063c5bbb-03d7-4cc2-9e06-617222b99e98 tempest-CinderUnicodeTest-373386968 None] Acquiring lock "cinder-414c581b-ca92-4cd3-8074-9301c9dabf4a-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:17 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-bb06dd65-62d0-4e5d-882b-4e5ee628e9dc req-65605795-38c5-402f-98b7-700e64e7efcf tempest-VolumesSnapshotsTestJSON-1243812076 None] Deleted volume successfully. Sep 25 17:19:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-063c5bbb-03d7-4cc2-9e06-617222b99e98 tempest-CinderUnicodeTest-373386968 None] Lock "cinder-414c581b-ca92-4cd3-8074-9301c9dabf4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-063c5bbb-03d7-4cc2-9e06-617222b99e98 tempest-CinderUnicodeTest-373386968 None] Acquiring lock "cinder-quobyte-78c6f1fe-897f-4937-8ab1-d99f552e27d7" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-bb06dd65-62d0-4e5d-882b-4e5ee628e9dc req-65605795-38c5-402f-98b7-700e64e7efcf tempest-VolumesSnapshotsTestJSON-1243812076 None] Lock "cinder-e59b3ba2-cddd-4fe9-a0a5-efe1a1052458-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-063c5bbb-03d7-4cc2-9e06-617222b99e98 tempest-CinderUnicodeTest-373386968 None] Lock "cinder-quobyte-78c6f1fe-897f-4937-8ab1-d99f552e27d7" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-063c5bbb-03d7-4cc2-9e06-617222b99e98 tempest-CinderUnicodeTest-373386968 None] Acquiring lock "cinder-quobyte-414c581b-ca92-4cd3-8074-9301c9dabf4a" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-063c5bbb-03d7-4cc2-9e06-617222b99e98 tempest-CinderUnicodeTest-373386968 None] Lock "cinder-quobyte-414c581b-ca92-4cd3-8074-9301c9dabf4a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-063c5bbb-03d7-4cc2-9e06-617222b99e98 tempest-CinderUnicodeTest-373386968 None] Deleting offline snapshot 414c581b-ca92-4cd3-8074-9301c9dabf4a of volume 78c6f1fe-897f-4937-8ab1-d99f552e27d7 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:19:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-063c5bbb-03d7-4cc2-9e06-617222b99e98 tempest-CinderUnicodeTest-373386968 None] snapshot_file for this snap is: volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.414c581b-ca92-4cd3-8074-9301c9dabf4a {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:19:17 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4433c0-3a48-435f-aea2-48d59c0c706b]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-063c5bbb-03d7-4cc2-9e06-617222b99e98 tempest-CinderUnicodeTest-373386968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.414c581b-ca92-4cd3-8074-9301c9dabf4a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:18 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.414c581b-ca92-4cd3-8074-9301c9dabf4a Sep 25 17:19:18 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:18 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-063c5bbb-03d7-4cc2-9e06-617222b99e98 tempest-CinderUnicodeTest-373386968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.414c581b-ca92-4cd3-8074-9301c9dabf4a" returned: 0 in 0.490s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:18 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-063c5bbb-03d7-4cc2-9e06-617222b99e98 tempest-CinderUnicodeTest-373386968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:19:18 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f4f3f6-851c-4297-b2af-b27b1884f882]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-063c5bbb-03d7-4cc2-9e06-617222b99e98 tempest-CinderUnicodeTest-373386968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:18 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7 Sep 25 17:19:18 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:19 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-063c5bbb-03d7-4cc2-9e06-617222b99e98 tempest-CinderUnicodeTest-373386968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7" returned: 0 in 0.677s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-063c5bbb-03d7-4cc2-9e06-617222b99e98 tempest-CinderUnicodeTest-373386968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.414c581b-ca92-4cd3-8074-9301c9dabf4a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:19 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.414c581b-ca92-4cd3-8074-9301c9dabf4a Sep 25 17:19:19 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:19 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-063c5bbb-03d7-4cc2-9e06-617222b99e98 tempest-CinderUnicodeTest-373386968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.414c581b-ca92-4cd3-8074-9301c9dabf4a" returned: 0 in 0.555s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-063c5bbb-03d7-4cc2-9e06-617222b99e98 tempest-CinderUnicodeTest-373386968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.414c581b-ca92-4cd3-8074-9301c9dabf4a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:19 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.414c581b-ca92-4cd3-8074-9301c9dabf4a Sep 25 17:19:19 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:20 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-063c5bbb-03d7-4cc2-9e06-617222b99e98 tempest-CinderUnicodeTest-373386968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7.414c581b-ca92-4cd3-8074-9301c9dabf4a" returned: 0 in 0.494s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:20 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-063c5bbb-03d7-4cc2-9e06-617222b99e98 tempest-CinderUnicodeTest-373386968 None] Lock "cinder-quobyte-414c581b-ca92-4cd3-8074-9301c9dabf4a" released by "_delete_snapshot" :: held 2.370s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:20 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-063c5bbb-03d7-4cc2-9e06-617222b99e98 tempest-CinderUnicodeTest-373386968 None] Lock "cinder-quobyte-78c6f1fe-897f-4937-8ab1-d99f552e27d7" released by "delete_snapshot" :: held 2.410s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:20 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-063c5bbb-03d7-4cc2-9e06-617222b99e98 tempest-CinderUnicodeTest-373386968 None] Created reservations ['1e8b9b70-b91d-4ed1-ba8a-4d2f57cae1e1', '87681580-38cf-441a-8389-d5c55be58aa1', '04b0217a-55e4-4bb2-8c8b-45f4cb2b3b31', '06cc9cec-f0c4-4530-bce7-4789db3487aa'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:20 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-063c5bbb-03d7-4cc2-9e06-617222b99e98 tempest-CinderUnicodeTest-373386968 None] Delete snapshot completed successfully. Sep 25 17:19:20 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-063c5bbb-03d7-4cc2-9e06-617222b99e98 tempest-CinderUnicodeTest-373386968 None] Lock "cinder-414c581b-ca92-4cd3-8074-9301c9dabf4a-delete_snapshot" released by "delete_snapshot" :: held 2.660s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d049ef75-b4ac-4467-ab0e-af10a5fed10f tempest-CinderUnicodeTest-373386968 None] Acquiring lock "cinder-78c6f1fe-897f-4937-8ab1-d99f552e27d7-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d049ef75-b4ac-4467-ab0e-af10a5fed10f tempest-CinderUnicodeTest-373386968 None] Lock "cinder-78c6f1fe-897f-4937-8ab1-d99f552e27d7-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d049ef75-b4ac-4467-ab0e-af10a5fed10f tempest-CinderUnicodeTest-373386968 None] Acquiring lock "cinder-quobyte-78c6f1fe-897f-4937-8ab1-d99f552e27d7" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d049ef75-b4ac-4467-ab0e-af10a5fed10f tempest-CinderUnicodeTest-373386968 None] Lock "cinder-quobyte-78c6f1fe-897f-4937-8ab1-d99f552e27d7" acquired by "delete_volume" :: waited 0.022s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:21 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9047a4-81f4-4bb2-9900-5e00b3ee60cc]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d049ef75-b4ac-4467-ab0e-af10a5fed10f tempest-CinderUnicodeTest-373386968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:21 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7 Sep 25 17:19:21 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:21 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d049ef75-b4ac-4467-ab0e-af10a5fed10f tempest-CinderUnicodeTest-373386968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7" returned: 0 in 0.582s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d049ef75-b4ac-4467-ab0e-af10a5fed10f tempest-CinderUnicodeTest-373386968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:21 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7 Sep 25 17:19:21 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:22 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d049ef75-b4ac-4467-ab0e-af10a5fed10f tempest-CinderUnicodeTest-373386968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-78c6f1fe-897f-4937-8ab1-d99f552e27d7" returned: 0 in 0.407s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d049ef75-b4ac-4467-ab0e-af10a5fed10f tempest-CinderUnicodeTest-373386968 None] Lock "cinder-quobyte-78c6f1fe-897f-4937-8ab1-d99f552e27d7" released by "delete_volume" :: held 1.114s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:22 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-d049ef75-b4ac-4467-ab0e-af10a5fed10f tempest-CinderUnicodeTest-373386968 None] Created reservations ['8549c7c9-f0f9-4e8b-a99e-31a671271769', 'f8bc19a1-97d1-435b-aaf2-ba771a6c2e65', 'f7c76480-bc64-4f5d-9b0d-b52d992abc2c', '3e572435-b0e3-4343-b9fa-1af7b3149568'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d049ef75-b4ac-4467-ab0e-af10a5fed10f tempest-CinderUnicodeTest-373386968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d049ef75-b4ac-4467-ab0e-af10a5fed10f tempest-CinderUnicodeTest-373386968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d049ef75-b4ac-4467-ab0e-af10a5fed10f tempest-CinderUnicodeTest-373386968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d049ef75-b4ac-4467-ab0e-af10a5fed10f tempest-CinderUnicodeTest-373386968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d049ef75-b4ac-4467-ab0e-af10a5fed10f tempest-CinderUnicodeTest-373386968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d049ef75-b4ac-4467-ab0e-af10a5fed10f tempest-CinderUnicodeTest-373386968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:22 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:19:22 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:22 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d049ef75-b4ac-4467-ab0e-af10a5fed10f tempest-CinderUnicodeTest-373386968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.432s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:22 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-d049ef75-b4ac-4467-ab0e-af10a5fed10f tempest-CinderUnicodeTest-373386968 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:22 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-d049ef75-b4ac-4467-ab0e-af10a5fed10f tempest-CinderUnicodeTest-373386968 None] Deleted volume successfully. Sep 25 17:19:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d049ef75-b4ac-4467-ab0e-af10a5fed10f tempest-CinderUnicodeTest-373386968 None] Lock "cinder-78c6f1fe-897f-4937-8ab1-d99f552e27d7-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9e8890e0-8b6b-49f1-949b-53ecee1ea968 tempest-CinderUnicodeTest-373386968 None] Acquiring lock "cinder-6a92eb71-f98c-4486-9629-92a07ed7dd43-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9e8890e0-8b6b-49f1-949b-53ecee1ea968 tempest-CinderUnicodeTest-373386968 None] Lock "cinder-6a92eb71-f98c-4486-9629-92a07ed7dd43-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9e8890e0-8b6b-49f1-949b-53ecee1ea968 tempest-CinderUnicodeTest-373386968 None] Acquiring lock "cinder-quobyte-6a92eb71-f98c-4486-9629-92a07ed7dd43" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9e8890e0-8b6b-49f1-949b-53ecee1ea968 tempest-CinderUnicodeTest-373386968 None] Lock "cinder-quobyte-6a92eb71-f98c-4486-9629-92a07ed7dd43" acquired by "delete_volume" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:23 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[43da6c12-67ea-4ac6-a26b-2f4ef9a5585e]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e8890e0-8b6b-49f1-949b-53ecee1ea968 tempest-CinderUnicodeTest-373386968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6a92eb71-f98c-4486-9629-92a07ed7dd43 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:23 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6a92eb71-f98c-4486-9629-92a07ed7dd43 Sep 25 17:19:23 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:24 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e8890e0-8b6b-49f1-949b-53ecee1ea968 tempest-CinderUnicodeTest-373386968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6a92eb71-f98c-4486-9629-92a07ed7dd43" returned: 0 in 0.545s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e8890e0-8b6b-49f1-949b-53ecee1ea968 tempest-CinderUnicodeTest-373386968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6a92eb71-f98c-4486-9629-92a07ed7dd43 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:24 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6a92eb71-f98c-4486-9629-92a07ed7dd43 Sep 25 17:19:24 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Flow 'volume_create_manager' (f282cb90-1ad8-4ba7-b093-77ca2d777f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8a59a7-a4f5-4cd5-97a5-e1df2fe98269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8a59a7-a4f5-4cd5-97a5-e1df2fe98269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2233232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9166105a-2627-4609-9621-5acf16c6e029,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7795f5bc955142449921ef4193d94ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:24Z,use_quota=True,user_id='893a0a3162434d9d8cee5370c0ffd8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40945705-bda3-4752-90a0-8a3d14e847ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40945705-bda3-4752-90a0-8a3d14e847ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e31cdb6-639f-44e9-be9e-426271c68c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e31cdb6-639f-44e9-be9e-426271c68c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9166105a-2627-4609-9621-5acf16c6e029', 'volume_name': 'volume-9166105a-2627-4609-9621-5acf16c6e029', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f5b4cb-6e71-47e0-9c01-7a20fc462ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f5b4cb-6e71-47e0-9c01-7a20fc462ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8463e0b-4d7a-46e3-a9da-12cb2810d9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:24 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Volume 9166105a-2627-4609-9621-5acf16c6e029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9166105a-2627-4609-9621-5acf16c6e029', 'volume_size': 1} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2233232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9166105a-2627-4609-9621-5acf16c6e029,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7795f5bc955142449921ef4193d94ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:24Z,use_quota=True,user_id='893a0a3162434d9d8cee5370c0ffd8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Creating volume 9166105a-2627-4609-9621-5acf16c6e029 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:19:24 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9166105a-2627-4609-9621-5acf16c6e029 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:24 devstack sudo[104213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9166105a-2627-4609-9621-5acf16c6e029 1073741824 Sep 25 17:19:24 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:24 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e8890e0-8b6b-49f1-949b-53ecee1ea968 tempest-CinderUnicodeTest-373386968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6a92eb71-f98c-4486-9629-92a07ed7dd43" returned: 0 in 0.484s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9e8890e0-8b6b-49f1-949b-53ecee1ea968 tempest-CinderUnicodeTest-373386968 None] Lock "cinder-quobyte-6a92eb71-f98c-4486-9629-92a07ed7dd43" released by "delete_volume" :: held 1.110s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-9e8890e0-8b6b-49f1-949b-53ecee1ea968 tempest-CinderUnicodeTest-373386968 None] Created reservations ['55405664-2533-4e9f-96ab-8df9e6eda9c1', 'a495cc7f-b137-4f10-912e-65b84d0bae38', 'da86a2b0-9491-4f1f-87eb-654e59d11399', '763388b7-1882-4251-b2ae-b9b4d457c0ac'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9e8890e0-8b6b-49f1-949b-53ecee1ea968 tempest-CinderUnicodeTest-373386968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9e8890e0-8b6b-49f1-949b-53ecee1ea968 tempest-CinderUnicodeTest-373386968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9e8890e0-8b6b-49f1-949b-53ecee1ea968 tempest-CinderUnicodeTest-373386968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9e8890e0-8b6b-49f1-949b-53ecee1ea968 tempest-CinderUnicodeTest-373386968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9e8890e0-8b6b-49f1-949b-53ecee1ea968 tempest-CinderUnicodeTest-373386968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e8890e0-8b6b-49f1-949b-53ecee1ea968 tempest-CinderUnicodeTest-373386968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:24 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:19:24 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:25 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9166105a-2627-4609-9621-5acf16c6e029 1073741824" returned: 0 in 0.642s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9166105a-2627-4609-9621-5acf16c6e029 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:25 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9166105a-2627-4609-9621-5acf16c6e029 Sep 25 17:19:25 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:25 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e8890e0-8b6b-49f1-949b-53ecee1ea968 tempest-CinderUnicodeTest-373386968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.403s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:25 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9e8890e0-8b6b-49f1-949b-53ecee1ea968 tempest-CinderUnicodeTest-373386968 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:25 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-9e8890e0-8b6b-49f1-949b-53ecee1ea968 tempest-CinderUnicodeTest-373386968 None] Deleted volume successfully. Sep 25 17:19:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9e8890e0-8b6b-49f1-949b-53ecee1ea968 tempest-CinderUnicodeTest-373386968 None] Lock "cinder-6a92eb71-f98c-4486-9629-92a07ed7dd43-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:25 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9166105a-2627-4609-9621-5acf16c6e029" returned: 0 in 0.323s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:25 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:19:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:25 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8463e0b-4d7a-46e3-a9da-12cb2810d9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9166105a-2627-4609-9621-5acf16c6e029', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:25 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f9524c-348f-478c-a251-52a650bb5f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:25 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Volume volume-9166105a-2627-4609-9621-5acf16c6e029 (9166105a-2627-4609-9621-5acf16c6e029): created successfully Sep 25 17:19:25 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f9524c-348f-478c-a251-52a650bb5f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:25 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Flow 'volume_create_manager' (f282cb90-1ad8-4ba7-b093-77ca2d777f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:25 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-27f32a26-787b-42e8-9d97-768122d1f873 tempest-VolumesTestJSON-181932560 None] Created volume successfully. Sep 25 17:19:27 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:19:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Flow 'volume_create_manager' (96fe5ba2-e572-41c1-be54-a8f275c73336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481afb14-06bc-4085-9ebb-c04fc758e6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481afb14-06bc-4085-9ebb-c04fc758e6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1191060648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080412d6-1ecd-4a13-983d-f6478dfadfa6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7795f5bc955142449921ef4193d94ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:27Z,use_quota=True,user_id='893a0a3162434d9d8cee5370c0ffd8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a58cf7c-02b6-4a1c-aa19-a29ff6bae0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a58cf7c-02b6-4a1c-aa19-a29ff6bae0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7fb1a99-906d-4de6-96e1-9285be2b55b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7fb1a99-906d-4de6-96e1-9285be2b55b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '080412d6-1ecd-4a13-983d-f6478dfadfa6', 'volume_name': 'volume-080412d6-1ecd-4a13-983d-f6478dfadfa6', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c840d720-f394-429d-a808-c0c42905f410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c840d720-f394-429d-a808-c0c42905f410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b641c2-0fed-468c-8de5-2323e092d3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:27 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Volume 080412d6-1ecd-4a13-983d-f6478dfadfa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-080412d6-1ecd-4a13-983d-f6478dfadfa6', 'volume_size': 1} Sep 25 17:19:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1191060648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080412d6-1ecd-4a13-983d-f6478dfadfa6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7795f5bc955142449921ef4193d94ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:27Z,use_quota=True,user_id='893a0a3162434d9d8cee5370c0ffd8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:19:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Creating volume 080412d6-1ecd-4a13-983d-f6478dfadfa6 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:19:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:19:27 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:19:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-080412d6-1ecd-4a13-983d-f6478dfadfa6 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:27 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-080412d6-1ecd-4a13-983d-f6478dfadfa6 1073741824 Sep 25 17:19:27 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:28 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-080412d6-1ecd-4a13-983d-f6478dfadfa6 1073741824" returned: 0 in 0.541s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-080412d6-1ecd-4a13-983d-f6478dfadfa6 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:28 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-080412d6-1ecd-4a13-983d-f6478dfadfa6 Sep 25 17:19:28 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:28 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-080412d6-1ecd-4a13-983d-f6478dfadfa6" returned: 0 in 0.345s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:28 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:19:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b641c2-0fed-468c-8de5-2323e092d3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-080412d6-1ecd-4a13-983d-f6478dfadfa6', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5237f01d-fdeb-4bfe-a3e0-959832f2617a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:28 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Volume volume-080412d6-1ecd-4a13-983d-f6478dfadfa6 (080412d6-1ecd-4a13-983d-f6478dfadfa6): created successfully Sep 25 17:19:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5237f01d-fdeb-4bfe-a3e0-959832f2617a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Flow 'volume_create_manager' (96fe5ba2-e572-41c1-be54-a8f275c73336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:28 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-9909f493-1708-4897-8693-75c93870e7f5 tempest-VolumesTestJSON-181932560 None] Created volume successfully. Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Flow 'volume_create_manager' (20c2700e-d473-42a0-91b6-e7448180df1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0137f8d5-4c24-41a0-9046-bb89797786b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0137f8d5-4c24-41a0-9046-bb89797786b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-404193222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a2d3a7-6249-40ec-aa93-9adb22c96466,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7795f5bc955142449921ef4193d94ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:30Z,use_quota=True,user_id='893a0a3162434d9d8cee5370c0ffd8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56d5771-7d48-419d-aada-7fe4645834a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56d5771-7d48-419d-aada-7fe4645834a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f920766-e005-424d-b85e-c53a9a405e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f920766-e005-424d-b85e-c53a9a405e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25a2d3a7-6249-40ec-aa93-9adb22c96466', 'volume_name': 'volume-25a2d3a7-6249-40ec-aa93-9adb22c96466', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1658a3be-5ee9-4ebc-aab0-7433615af941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1658a3be-5ee9-4ebc-aab0-7433615af941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df30c50c-3db7-460c-a753-9a0292df08f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:30 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Volume 25a2d3a7-6249-40ec-aa93-9adb22c96466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25a2d3a7-6249-40ec-aa93-9adb22c96466', 'volume_size': 1} Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-404193222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a2d3a7-6249-40ec-aa93-9adb22c96466,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7795f5bc955142449921ef4193d94ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:30Z,use_quota=True,user_id='893a0a3162434d9d8cee5370c0ffd8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Creating volume 25a2d3a7-6249-40ec-aa93-9adb22c96466 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:19:30 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-25a2d3a7-6249-40ec-aa93-9adb22c96466 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:30 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-25a2d3a7-6249-40ec-aa93-9adb22c96466 1073741824 Sep 25 17:19:30 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:30 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-25a2d3a7-6249-40ec-aa93-9adb22c96466 1073741824" returned: 0 in 0.644s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-25a2d3a7-6249-40ec-aa93-9adb22c96466 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:31 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-25a2d3a7-6249-40ec-aa93-9adb22c96466 Sep 25 17:19:31 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:31 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-25a2d3a7-6249-40ec-aa93-9adb22c96466" returned: 0 in 0.393s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:31 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:19:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df30c50c-3db7-460c-a753-9a0292df08f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25a2d3a7-6249-40ec-aa93-9adb22c96466', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc14e845-18f6-4586-95c5-c1b9b67c0893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:31 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Volume volume-25a2d3a7-6249-40ec-aa93-9adb22c96466 (25a2d3a7-6249-40ec-aa93-9adb22c96466): created successfully Sep 25 17:19:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc14e845-18f6-4586-95c5-c1b9b67c0893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Flow 'volume_create_manager' (20c2700e-d473-42a0-91b6-e7448180df1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:31 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-5c60264b-d33e-4b1e-aebf-abbca90bf28e tempest-VolumesTestJSON-181932560 None] Created volume successfully. Sep 25 17:19:32 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:19:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Flow 'volume_create_manager' (1d44ecfa-e94b-4eca-8ef5-e30f648d451f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1994828f-8583-479a-bb57-1dba3b05aad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1994828f-8583-479a-bb57-1dba3b05aad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bdcbf93ca5846348e2ed53f534473f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:32Z,use_quota=True,user_id='2480f88116b24a119a8b47ddc3b12607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afd0fc8a-3971-407b-91d0-b1be78e5aa23),volume_type_id=afd0fc8a-3971-407b-91d0-b1be78e5aa23)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a3e44f-76ad-41f2-b8d9-ac22a6e1de88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a3e44f-76ad-41f2-b8d9-ac22a6e1de88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94fb2877-1eb5-4066-bc99-7bf9aac926b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:32 devstack cinder-volume[87211]: DEBUG cinder.image.glance [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Creating Keystone auth plugin from conf {{(pid=87211) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 17:19:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94fb2877-1eb5-4066-bc99-7bf9aac926b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b', 'volume_name': 'volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b', 'volume_size': 1, 'image_id': 'b11a013a-985f-4eac-82b8-b286fe02e1af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b11a013a-985f-4eac-82b8-b286fe02e1af', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2a9e74cfc731fde73a7316b2c7e80715', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1bdcbf93ca5846348e2ed53f534473f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'be955fc800d3b77e033349806db71f37043bb3fb281387f3116e03474c45c54e1259731d0ae52e7ff5b7e20d1c493da04f8e0375470347acf27de039d94e3a32', 'id': 'b11a013a-985f-4eac-82b8-b286fe02e1af', 'created_at': datetime.datetime(2026, 9, 25, 15, 19, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 19, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b11a013a-985f-4eac-82b8-b286fe02e1af/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce71f97-f2f4-4594-8958-9fc655b0f27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce71f97-f2f4-4594-8958-9fc655b0f27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecfbda6b-1025-4145-9960-53f8ca53f891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:32 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Volume fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b', 'volume_size': 1, 'image_id': 'b11a013a-985f-4eac-82b8-b286fe02e1af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b11a013a-985f-4eac-82b8-b286fe02e1af', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2a9e74cfc731fde73a7316b2c7e80715', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1bdcbf93ca5846348e2ed53f534473f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'be955fc800d3b77e033349806db71f37043bb3fb281387f3116e03474c45c54e1259731d0ae52e7ff5b7e20d1c493da04f8e0375470347acf27de039d94e3a32', 'id': 'b11a013a-985f-4eac-82b8-b286fe02e1af', 'created_at': datetime.datetime(2026, 9, 25, 15, 19, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 19, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b11a013a-985f-4eac-82b8-b286fe02e1af/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 17:19:32 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Trying to clone fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b from image b11a013a-985f-4eac-82b8-b286fe02e1af at location (None, [{'url': 'file:///opt/stack/data/glance/images/b11a013a-985f-4eac-82b8-b286fe02e1af', 'metadata': {}}]). {{(pid=87211) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 17:19:32 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 17:19:32 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Image download 0.00 MB at 0.00 MB/s Sep 25 17:19:33 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f167f6b3-0697-494d-a486-2b52a1d4c8bf]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:33 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD Sep 25 17:19:33 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:33 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b98aeaca-131b-4c34-acf6-c4b31538b051 tempest-VolumesTestJSON-181932560 None] Acquiring lock "cinder-25a2d3a7-6249-40ec-aa93-9adb22c96466-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b98aeaca-131b-4c34-acf6-c4b31538b051 tempest-VolumesTestJSON-181932560 None] Lock "cinder-25a2d3a7-6249-40ec-aa93-9adb22c96466-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b98aeaca-131b-4c34-acf6-c4b31538b051 tempest-VolumesTestJSON-181932560 None] Acquiring lock "cinder-quobyte-25a2d3a7-6249-40ec-aa93-9adb22c96466" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b98aeaca-131b-4c34-acf6-c4b31538b051 tempest-VolumesTestJSON-181932560 None] Lock "cinder-quobyte-25a2d3a7-6249-40ec-aa93-9adb22c96466" acquired by "delete_volume" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:33 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[be345801-b9e6-466f-8e90-cacfaa03fc82]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b98aeaca-131b-4c34-acf6-c4b31538b051 tempest-VolumesTestJSON-181932560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-25a2d3a7-6249-40ec-aa93-9adb22c96466 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:33 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD Sep 25 17:19:33 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:33 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-25a2d3a7-6249-40ec-aa93-9adb22c96466 Sep 25 17:19:33 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:33 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD" returned: 1 in 0.398s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:19:33 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Temporary image b11a013a-985f-4eac-82b8-b286fe02e1af is fetched for user 2480f88116b24a119a8b47ddc3b12607. {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 17:19:33 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[65467466-3bc8-43d2-b358-f4d51c315538]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:33 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b98aeaca-131b-4c34-acf6-c4b31538b051 tempest-VolumesTestJSON-181932560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-25a2d3a7-6249-40ec-aa93-9adb22c96466" returned: 0 in 0.475s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b98aeaca-131b-4c34-acf6-c4b31538b051 tempest-VolumesTestJSON-181932560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-25a2d3a7-6249-40ec-aa93-9adb22c96466 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:34 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD Sep 25 17:19:34 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:34 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-25a2d3a7-6249-40ec-aa93-9adb22c96466 Sep 25 17:19:34 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:34 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:34 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b98aeaca-131b-4c34-acf6-c4b31538b051 tempest-VolumesTestJSON-181932560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-25a2d3a7-6249-40ec-aa93-9adb22c96466" returned: 0 in 0.329s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b98aeaca-131b-4c34-acf6-c4b31538b051 tempest-VolumesTestJSON-181932560 None] Lock "cinder-quobyte-25a2d3a7-6249-40ec-aa93-9adb22c96466" released by "delete_volume" :: held 0.863s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:34 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD Sep 25 17:19:34 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-b98aeaca-131b-4c34-acf6-c4b31538b051 tempest-VolumesTestJSON-181932560 None] Created reservations ['268022b5-0d46-4aec-b315-ef2b3b5118c8', '62ea70b0-3892-4d95-a4fa-b3fa2f88e3fe', '66cbd2bf-ced5-4932-aeca-07b5bd14c5ad', 'f0e65810-9a2b-45b0-9983-de15d72b200b'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b98aeaca-131b-4c34-acf6-c4b31538b051 tempest-VolumesTestJSON-181932560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b98aeaca-131b-4c34-acf6-c4b31538b051 tempest-VolumesTestJSON-181932560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b98aeaca-131b-4c34-acf6-c4b31538b051 tempest-VolumesTestJSON-181932560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b98aeaca-131b-4c34-acf6-c4b31538b051 tempest-VolumesTestJSON-181932560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b98aeaca-131b-4c34-acf6-c4b31538b051 tempest-VolumesTestJSON-181932560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b98aeaca-131b-4c34-acf6-c4b31538b051 tempest-VolumesTestJSON-181932560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:34 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:19:34 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d7e6acf5-5324-4eb9-beb1-b3dda84a2e27 tempest-VolumesTestJSON-181932560 None] Acquiring lock "cinder-080412d6-1ecd-4a13-983d-f6478dfadfa6-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d7e6acf5-5324-4eb9-beb1-b3dda84a2e27 tempest-VolumesTestJSON-181932560 None] Lock "cinder-080412d6-1ecd-4a13-983d-f6478dfadfa6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:34 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD" returned: 1 in 0.445s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bdcbf93ca5846348e2ed53f534473f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:32Z,use_quota=True,user_id='2480f88116b24a119a8b47ddc3b12607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afd0fc8a-3971-407b-91d0-b1be78e5aa23),volume_type_id=afd0fc8a-3971-407b-91d0-b1be78e5aa23)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Creating volume fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:19:34 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d7e6acf5-5324-4eb9-beb1-b3dda84a2e27 tempest-VolumesTestJSON-181932560 None] Acquiring lock "cinder-quobyte-080412d6-1ecd-4a13-983d-f6478dfadfa6" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:34 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b 1073741824 Sep 25 17:19:34 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d7e6acf5-5324-4eb9-beb1-b3dda84a2e27 tempest-VolumesTestJSON-181932560 None] Lock "cinder-quobyte-080412d6-1ecd-4a13-983d-f6478dfadfa6" acquired by "delete_volume" :: waited 0.031s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeede80c-9bdb-405a-9499-5fea26ed9164]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d7e6acf5-5324-4eb9-beb1-b3dda84a2e27 tempest-VolumesTestJSON-181932560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-080412d6-1ecd-4a13-983d-f6478dfadfa6 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:34 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b98aeaca-131b-4c34-acf6-c4b31538b051 tempest-VolumesTestJSON-181932560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.302s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-b98aeaca-131b-4c34-acf6-c4b31538b051 tempest-VolumesTestJSON-181932560 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:34 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b98aeaca-131b-4c34-acf6-c4b31538b051 tempest-VolumesTestJSON-181932560 None] Deleted volume successfully. Sep 25 17:19:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b98aeaca-131b-4c34-acf6-c4b31538b051 tempest-VolumesTestJSON-181932560 None] Lock "cinder-25a2d3a7-6249-40ec-aa93-9adb22c96466-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:34 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-080412d6-1ecd-4a13-983d-f6478dfadfa6 Sep 25 17:19:34 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:35 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b 1073741824" returned: 0 in 0.521s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:35 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d7e6acf5-5324-4eb9-beb1-b3dda84a2e27 tempest-VolumesTestJSON-181932560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-080412d6-1ecd-4a13-983d-f6478dfadfa6" returned: 0 in 0.472s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d7e6acf5-5324-4eb9-beb1-b3dda84a2e27 tempest-VolumesTestJSON-181932560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-080412d6-1ecd-4a13-983d-f6478dfadfa6 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:35 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-080412d6-1ecd-4a13-983d-f6478dfadfa6 Sep 25 17:19:35 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:35 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b Sep 25 17:19:35 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:35 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b" returned: 0 in 0.251s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:35 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d7e6acf5-5324-4eb9-beb1-b3dda84a2e27 tempest-VolumesTestJSON-181932560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-080412d6-1ecd-4a13-983d-f6478dfadfa6" returned: 0 in 0.276s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d7e6acf5-5324-4eb9-beb1-b3dda84a2e27 tempest-VolumesTestJSON-181932560 None] Lock "cinder-quobyte-080412d6-1ecd-4a13-983d-f6478dfadfa6" released by "delete_volume" :: held 0.801s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Attempting download of b11a013a-985f-4eac-82b8-b286fe02e1af ((None, [{'url': 'file:///opt/stack/data/glance/images/b11a013a-985f-4eac-82b8-b286fe02e1af', 'metadata': {}}])) to volume fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b. {{(pid=87211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[449c60da-7908-42d6-89b1-da4842f438c1]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b11a013a-985f-4eac-82b8-b286fe02e1af_a8uud251 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-d7e6acf5-5324-4eb9-beb1-b3dda84a2e27 tempest-VolumesTestJSON-181932560 None] Created reservations ['b52e61ae-c4b4-41e6-964e-953970189e45', '70fcf4f0-677d-4f5a-8611-4e6d87a63c1e', '3847e8a1-e383-4b76-9df8-9a3e27e5752b', '649ab4e4-cbd1-4808-8d5b-8b68b669664b'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d7e6acf5-5324-4eb9-beb1-b3dda84a2e27 tempest-VolumesTestJSON-181932560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d7e6acf5-5324-4eb9-beb1-b3dda84a2e27 tempest-VolumesTestJSON-181932560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d7e6acf5-5324-4eb9-beb1-b3dda84a2e27 tempest-VolumesTestJSON-181932560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d7e6acf5-5324-4eb9-beb1-b3dda84a2e27 tempest-VolumesTestJSON-181932560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d7e6acf5-5324-4eb9-beb1-b3dda84a2e27 tempest-VolumesTestJSON-181932560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d7e6acf5-5324-4eb9-beb1-b3dda84a2e27 tempest-VolumesTestJSON-181932560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:35 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b11a013a-985f-4eac-82b8-b286fe02e1af_a8uud251 Sep 25 17:19:35 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:35 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:19:35 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ea10779e-ff22-4e14-aa53-36a00aa49522 tempest-VolumesTestJSON-181932560 None] Acquiring lock "cinder-9166105a-2627-4609-9621-5acf16c6e029-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ea10779e-ff22-4e14-aa53-36a00aa49522 tempest-VolumesTestJSON-181932560 None] Lock "cinder-9166105a-2627-4609-9621-5acf16c6e029-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ea10779e-ff22-4e14-aa53-36a00aa49522 tempest-VolumesTestJSON-181932560 None] Acquiring lock "cinder-quobyte-9166105a-2627-4609-9621-5acf16c6e029" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ea10779e-ff22-4e14-aa53-36a00aa49522 tempest-VolumesTestJSON-181932560 None] Lock "cinder-quobyte-9166105a-2627-4609-9621-5acf16c6e029" acquired by "delete_volume" :: waited 0.015s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[39071bd1-10fc-4e2a-9845-ac5e5c610ecf]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ea10779e-ff22-4e14-aa53-36a00aa49522 tempest-VolumesTestJSON-181932560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9166105a-2627-4609-9621-5acf16c6e029 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:36 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d7e6acf5-5324-4eb9-beb1-b3dda84a2e27 tempest-VolumesTestJSON-181932560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.285s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:36 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-d7e6acf5-5324-4eb9-beb1-b3dda84a2e27 tempest-VolumesTestJSON-181932560 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:36 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-d7e6acf5-5324-4eb9-beb1-b3dda84a2e27 tempest-VolumesTestJSON-181932560 None] Deleted volume successfully. Sep 25 17:19:36 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b11a013a-985f-4eac-82b8-b286fe02e1af_a8uud251" returned: 0 in 0.399s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b11a013a-985f-4eac-82b8-b286fe02e1af_a8uud251 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d7e6acf5-5324-4eb9-beb1-b3dda84a2e27 tempest-VolumesTestJSON-181932560 None] Lock "cinder-080412d6-1ecd-4a13-983d-f6478dfadfa6-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:36 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9166105a-2627-4609-9621-5acf16c6e029 Sep 25 17:19:36 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:36 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b11a013a-985f-4eac-82b8-b286fe02e1af_a8uud251 Sep 25 17:19:36 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:36 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ea10779e-ff22-4e14-aa53-36a00aa49522 tempest-VolumesTestJSON-181932560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9166105a-2627-4609-9621-5acf16c6e029" returned: 0 in 0.377s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ea10779e-ff22-4e14-aa53-36a00aa49522 tempest-VolumesTestJSON-181932560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9166105a-2627-4609-9621-5acf16c6e029 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:36 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9166105a-2627-4609-9621-5acf16c6e029 Sep 25 17:19:36 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:36 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b11a013a-985f-4eac-82b8-b286fe02e1af_a8uud251" returned: 1 in 0.346s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b11a013a-985f-4eac-82b8-b286fe02e1af_a8uud251' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:19:36 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7f23e3-d2cb-40ee-b61a-bb7b5390c6d3]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:36 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD Sep 25 17:19:36 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:36 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ea10779e-ff22-4e14-aa53-36a00aa49522 tempest-VolumesTestJSON-181932560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9166105a-2627-4609-9621-5acf16c6e029" returned: 0 in 0.261s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ea10779e-ff22-4e14-aa53-36a00aa49522 tempest-VolumesTestJSON-181932560 None] Lock "cinder-quobyte-9166105a-2627-4609-9621-5acf16c6e029" released by "delete_volume" :: held 0.696s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:36 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-ea10779e-ff22-4e14-aa53-36a00aa49522 tempest-VolumesTestJSON-181932560 None] Created reservations ['d79e8fbd-5102-4ee4-ac60-96f1388511fd', 'f9e3af8a-51e6-4051-b95f-1a1f22a35919', 'c2947a93-2114-4efd-936f-3aa548953c72', 'f5dc5a2f-e8bd-4002-965c-1a8878ffe74a'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ea10779e-ff22-4e14-aa53-36a00aa49522 tempest-VolumesTestJSON-181932560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ea10779e-ff22-4e14-aa53-36a00aa49522 tempest-VolumesTestJSON-181932560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ea10779e-ff22-4e14-aa53-36a00aa49522 tempest-VolumesTestJSON-181932560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:36 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ea10779e-ff22-4e14-aa53-36a00aa49522 tempest-VolumesTestJSON-181932560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ea10779e-ff22-4e14-aa53-36a00aa49522 tempest-VolumesTestJSON-181932560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ea10779e-ff22-4e14-aa53-36a00aa49522 tempest-VolumesTestJSON-181932560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:36 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:19:36 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:36 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD Sep 25 17:19:36 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:37 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ea10779e-ff22-4e14-aa53-36a00aa49522 tempest-VolumesTestJSON-181932560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.281s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:37 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-ea10779e-ff22-4e14-aa53-36a00aa49522 tempest-VolumesTestJSON-181932560 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:37 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-ea10779e-ff22-4e14-aa53-36a00aa49522 tempest-VolumesTestJSON-181932560 None] Deleted volume successfully. Sep 25 17:19:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ea10779e-ff22-4e14-aa53-36a00aa49522 tempest-VolumesTestJSON-181932560 None] Lock "cinder-9166105a-2627-4609-9621-5acf16c6e029-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:37 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD" returned: 1 in 0.355s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:19:37 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] b11a013a-985f-4eac-82b8-b286fe02e1af was raw, converting to qcow2 {{(pid=87211) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 17:19:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:37 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b Sep 25 17:19:37 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:37 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b" returned: 0 in 0.502s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:37 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b11a013a-985f-4eac-82b8-b286fe02e1af_x7duw4tldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:19:37 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 17:19:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:37 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b 1G Sep 25 17:19:37 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:37 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b 1G" returned: 0 in 0.336s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:37 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Downloaded image b11a013a-985f-4eac-82b8-b286fe02e1af ((None, [{'url': 'file:///opt/stack/data/glance/images/b11a013a-985f-4eac-82b8-b286fe02e1af', 'metadata': {}}])) to volume fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b successfully. {{(pid=87211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 17:19:37 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Temporary image b11a013a-985f-4eac-82b8-b286fe02e1af for user 2480f88116b24a119a8b47ddc3b12607 is deleted. {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 17:19:37 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Marking volume fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b as bootable. {{(pid=87211) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 17:19:38 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Copying metadata from image b11a013a-985f-4eac-82b8-b286fe02e1af to fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b. {{(pid=87211) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 17:19:38 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Creating volume glance metadata for volume fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b backed by image b11a013a-985f-4eac-82b8-b286fe02e1af with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b11a013a-985f-4eac-82b8-b286fe02e1af', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2a9e74cfc731fde73a7316b2c7e80715', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87211) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 17:19:38 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecfbda6b-1025-4145-9960-53f8ca53f891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b', 'volume_size': 1, 'image_id': 'b11a013a-985f-4eac-82b8-b286fe02e1af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b11a013a-985f-4eac-82b8-b286fe02e1af', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2a9e74cfc731fde73a7316b2c7e80715', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1bdcbf93ca5846348e2ed53f534473f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'be955fc800d3b77e033349806db71f37043bb3fb281387f3116e03474c45c54e1259731d0ae52e7ff5b7e20d1c493da04f8e0375470347acf27de039d94e3a32', 'id': 'b11a013a-985f-4eac-82b8-b286fe02e1af', 'created_at': datetime.datetime(2026, 9, 25, 15, 19, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 19, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b11a013a-985f-4eac-82b8-b286fe02e1af/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:38 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e6c54a-52e7-41bd-83ff-48db3d88325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:38 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Volume volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b (fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b): created successfully Sep 25 17:19:38 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e6c54a-52e7-41bd-83ff-48db3d88325f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:38 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Flow 'volume_create_manager' (1d44ecfa-e94b-4eca-8ef5-e30f648d451f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:38 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-25dede2b-3ea4-4e5e-b1cd-834b6f041df2 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Created volume successfully. Sep 25 17:19:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-58ed40fc-a4c7-4943-9a9b-45022f60fb06 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Acquiring lock "cinder-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-58ed40fc-a4c7-4943-9a9b-45022f60fb06 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Lock "cinder-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-58ed40fc-a4c7-4943-9a9b-45022f60fb06 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Acquiring lock "cinder-quobyte-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-58ed40fc-a4c7-4943-9a9b-45022f60fb06 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Lock "cinder-quobyte-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b" acquired by "delete_volume" :: waited 0.026s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:39 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27ac375-e73e-45ab-9e93-4faa47a3b3c0]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-58ed40fc-a4c7-4943-9a9b-45022f60fb06 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:39 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b Sep 25 17:19:39 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:39 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-58ed40fc-a4c7-4943-9a9b-45022f60fb06 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b" returned: 0 in 0.480s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-58ed40fc-a4c7-4943-9a9b-45022f60fb06 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:39 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b Sep 25 17:19:39 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:39 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-58ed40fc-a4c7-4943-9a9b-45022f60fb06 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b" returned: 0 in 0.275s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-58ed40fc-a4c7-4943-9a9b-45022f60fb06 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Lock "cinder-quobyte-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b" released by "delete_volume" :: held 0.834s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:39 devstack cinder-volume[87211]: WARNING cinder.quota [None req-58ed40fc-a4c7-4943-9a9b-45022f60fb06 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:19:39 devstack cinder-volume[87211]: WARNING cinder.quota [None req-58ed40fc-a4c7-4943-9a9b-45022f60fb06 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:19:39 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-58ed40fc-a4c7-4943-9a9b-45022f60fb06 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Created reservations ['00203720-26c7-4d19-a9ca-f0e5b41f4afd', '52b15d0b-856c-441b-b2b4-badc9c3f3a97', '732cb519-0a39-4e54-a808-83b16fc043c9', '9a4ab10c-ff15-44ed-a035-9000cd81ac7f'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-58ed40fc-a4c7-4943-9a9b-45022f60fb06 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-58ed40fc-a4c7-4943-9a9b-45022f60fb06 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-58ed40fc-a4c7-4943-9a9b-45022f60fb06 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-58ed40fc-a4c7-4943-9a9b-45022f60fb06 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-58ed40fc-a4c7-4943-9a9b-45022f60fb06 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-58ed40fc-a4c7-4943-9a9b-45022f60fb06 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:40 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:19:40 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:40 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-58ed40fc-a4c7-4943-9a9b-45022f60fb06 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.248s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:40 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-58ed40fc-a4c7-4943-9a9b-45022f60fb06 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:40 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-58ed40fc-a4c7-4943-9a9b-45022f60fb06 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Deleted volume successfully. Sep 25 17:19:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-58ed40fc-a4c7-4943-9a9b-45022f60fb06 tempest-VolumeAndVolumeTypeFromImageTest-397947068 None] Lock "cinder-fafa09dc-8b6c-47b5-b6ca-986b66ed8b3b-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2ccc6b74-5a03-41a5-846b-50ae7c54b17a tempest-BackendsCapabilitiesAdminTestsJSON-868939073 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.299087524414, 'free_capacity_gb': 1775.299087524414, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87211) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 17:19:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f132bd2b-55f9-44bb-a3be-e2138d6067a9 tempest-BackendsCapabilitiesAdminTestsJSON-868939073 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.299087524414, 'free_capacity_gb': 1775.299087524414, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87211) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 17:19:46 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:19:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Flow 'volume_create_manager' (0f9a472c-5902-4fa4-b4df-2356717c6037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (004543b2-f66f-424e-b35d-67396934c997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (004543b2-f66f-424e-b35d-67396934c997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-602358495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590b9554-30ee-4ec7-8de3-e4fb4f379843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54bc36b2c2f74ce5b396dcb404b40c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:47Z,use_quota=True,user_id='04a22d23bdd245aead3e7653a19bfc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc16904-e075-46ae-9033-c3ca7192c681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc16904-e075-46ae-9033-c3ca7192c681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ac3fed-3532-4a33-afb0-a2f3ac5df261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ac3fed-3532-4a33-afb0-a2f3ac5df261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '590b9554-30ee-4ec7-8de3-e4fb4f379843', 'volume_name': 'volume-590b9554-30ee-4ec7-8de3-e4fb4f379843', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd4d3eac-0443-4cdd-a008-9125ee52c54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd4d3eac-0443-4cdd-a008-9125ee52c54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dbbf05e-b5e0-46dc-b84d-3f97e319345a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:46 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Volume 590b9554-30ee-4ec7-8de3-e4fb4f379843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-590b9554-30ee-4ec7-8de3-e4fb4f379843', 'volume_size': 1} Sep 25 17:19:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:46 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-602358495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590b9554-30ee-4ec7-8de3-e4fb4f379843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54bc36b2c2f74ce5b396dcb404b40c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:47Z,use_quota=True,user_id='04a22d23bdd245aead3e7653a19bfc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:19:46 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Creating volume 590b9554-30ee-4ec7-8de3-e4fb4f379843 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:19:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:46 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:46 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:46 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:19:46 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:19:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-590b9554-30ee-4ec7-8de3-e4fb4f379843 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:46 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-590b9554-30ee-4ec7-8de3-e4fb4f379843 1073741824 Sep 25 17:19:46 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Flow 'volume_create_manager' (2c0d5a6d-9339-40c2-8964-24d8beb3035c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13109a0-f9ea-4eb1-ac3b-7775c83d1c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13109a0-f9ea-4eb1-ac3b-7775c83d1c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1835904908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb12deab-fcf9-4682-a320-3fe8a2fe0133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54bc36b2c2f74ce5b396dcb404b40c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:47Z,use_quota=True,user_id='04a22d23bdd245aead3e7653a19bfc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e88d8f1-ac8f-4541-8394-8963778aa317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e88d8f1-ac8f-4541-8394-8963778aa317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edff5e59-db1c-496b-9acc-540e72bc3016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edff5e59-db1c-496b-9acc-540e72bc3016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb12deab-fcf9-4682-a320-3fe8a2fe0133', 'volume_name': 'volume-eb12deab-fcf9-4682-a320-3fe8a2fe0133', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc48174d-b25a-49fb-a693-3b7f5a1f0901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc48174d-b25a-49fb-a693-3b7f5a1f0901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29ea176-4cb0-415f-a20e-d36d20f3fdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:47 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Volume eb12deab-fcf9-4682-a320-3fe8a2fe0133: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb12deab-fcf9-4682-a320-3fe8a2fe0133', 'volume_size': 1} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:47 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-590b9554-30ee-4ec7-8de3-e4fb4f379843 1073741824" returned: 0 in 0.541s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-590b9554-30ee-4ec7-8de3-e4fb4f379843 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:47 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-590b9554-30ee-4ec7-8de3-e4fb4f379843 Sep 25 17:19:47 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Flow 'volume_create_manager' (a00fe364-39f6-4385-b014-977d4a1d1786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3227c3a-b1e7-44ea-8ff9-517d676109b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3227c3a-b1e7-44ea-8ff9-517d676109b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-37988663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54bc36b2c2f74ce5b396dcb404b40c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:48Z,use_quota=True,user_id='04a22d23bdd245aead3e7653a19bfc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5277487-98f8-417c-b65d-db7d9b435cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5277487-98f8-417c-b65d-db7d9b435cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a8b228-ceb8-441f-8ccb-7abceaef4739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a8b228-ceb8-441f-8ccb-7abceaef4739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131', 'volume_name': 'volume-bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de36962e-437a-4f41-9e0b-bbee41cb78e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de36962e-437a-4f41-9e0b-bbee41cb78e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:47 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (866ae5bd-5960-43d8-a817-3082ba0cdbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:47 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Volume bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131', 'volume_size': 1} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-590b9554-30ee-4ec7-8de3-e4fb4f379843" returned: 0 in 0.379s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.565s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1835904908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb12deab-fcf9-4682-a320-3fe8a2fe0133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54bc36b2c2f74ce5b396dcb404b40c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:47Z,use_quota=True,user_id='04a22d23bdd245aead3e7653a19bfc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Creating volume eb12deab-fcf9-4682-a320-3fe8a2fe0133 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:19:47 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-eb12deab-fcf9-4682-a320-3fe8a2fe0133 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dbbf05e-b5e0-46dc-b84d-3f97e319345a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-590b9554-30ee-4ec7-8de3-e4fb4f379843', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b2c0c8-5fbd-499a-b0f0-b996c2bcaf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:47 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-eb12deab-fcf9-4682-a320-3fe8a2fe0133 1073741824 Sep 25 17:19:47 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:47 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Volume volume-590b9554-30ee-4ec7-8de3-e4fb4f379843 (590b9554-30ee-4ec7-8de3-e4fb4f379843): created successfully Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b2c0c8-5fbd-499a-b0f0-b996c2bcaf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Flow 'volume_create_manager' (0f9a472c-5902-4fa4-b4df-2356717c6037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:47 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-88ebf697-9f1e-4b67-a1f9-7ddc8cfb16ef tempest-CreateVolumesFromImageTest-1041778291 None] Created volume successfully. Sep 25 17:19:48 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-895590a4-df64-41a4-80c3-38f7cd4884eb tempest-GroupSnapshotsV319Test-931860325 None] Group tempest-GroupSnapshotsV319Test-Group-139715826: creating Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Flow 'volume_create_manager' (7ecec464-5424-4f27-a4d4-a5360d983cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a600e2d3-59e3-4992-8a3f-8b84e1b3f1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a600e2d3-59e3-4992-8a3f-8b84e1b3f1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-885174742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54bc36b2c2f74ce5b396dcb404b40c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:48Z,use_quota=True,user_id='04a22d23bdd245aead3e7653a19bfc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce00c10-fe63-4cb0-b3d5-57a6e751e070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce00c10-fe63-4cb0-b3d5-57a6e751e070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9e7e9b-2841-4773-a067-c8a37f706e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9e7e9b-2841-4773-a067-c8a37f706e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598', 'volume_name': 'volume-9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0225c38f-4775-451f-a8ef-945775d3b862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0225c38f-4775-451f-a8ef-945775d3b862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7058a3f-68c7-4af9-ab67-af64c9be6acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:48 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Volume 9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598', 'volume_size': 1} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:48 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-895590a4-df64-41a4-80c3-38f7cd4884eb tempest-GroupSnapshotsV319Test-931860325 None] Group tempest-GroupSnapshotsV319Test-Group-139715826: created successfully Sep 25 17:19:48 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:48 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-895590a4-df64-41a4-80c3-38f7cd4884eb tempest-GroupSnapshotsV319Test-931860325 None] Create group completed successfully. Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-eb12deab-fcf9-4682-a320-3fe8a2fe0133 1073741824" returned: 0 in 0.632s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-eb12deab-fcf9-4682-a320-3fe8a2fe0133 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:48 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-eb12deab-fcf9-4682-a320-3fe8a2fe0133 Sep 25 17:19:48 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Flow 'volume_create_manager' (40a45d94-b8f2-41b3-a674-fd6d367ec8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb54aba-704d-4e60-b3e5-ee07fb38f178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb54aba-704d-4e60-b3e5-ee07fb38f178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-482129217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503fb4df-9fdd-4268-9ecd-7403ff129bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54bc36b2c2f74ce5b396dcb404b40c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:48Z,use_quota=True,user_id='04a22d23bdd245aead3e7653a19bfc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b148b90-c998-4f31-9ac6-663ea974023a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b148b90-c998-4f31-9ac6-663ea974023a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4207f290-29cb-4b88-8975-42e87ab8b386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4207f290-29cb-4b88-8975-42e87ab8b386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '503fb4df-9fdd-4268-9ecd-7403ff129bf0', 'volume_name': 'volume-503fb4df-9fdd-4268-9ecd-7403ff129bf0', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52dadb28-810e-490d-8f46-15c90416c702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52dadb28-810e-490d-8f46-15c90416c702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190d7737-794b-47bd-9794-49138fe62c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:48 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Volume 503fb4df-9fdd-4268-9ecd-7403ff129bf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-503fb4df-9fdd-4268-9ecd-7403ff129bf0', 'volume_size': 1} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:48 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-eb12deab-fcf9-4682-a320-3fe8a2fe0133" returned: 0 in 0.301s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.992s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-37988663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54bc36b2c2f74ce5b396dcb404b40c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:48Z,use_quota=True,user_id='04a22d23bdd245aead3e7653a19bfc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Creating volume bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:19:48 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:48 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131 1073741824 Sep 25 17:19:48 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29ea176-4cb0-415f-a20e-d36d20f3fdff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb12deab-fcf9-4682-a320-3fe8a2fe0133', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4629191e-bc10-4660-b5a4-84a01cfa8fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:48 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Volume volume-eb12deab-fcf9-4682-a320-3fe8a2fe0133 (eb12deab-fcf9-4682-a320-3fe8a2fe0133): created successfully Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4629191e-bc10-4660-b5a4-84a01cfa8fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Flow 'volume_create_manager' (2c0d5a6d-9339-40c2-8964-24d8beb3035c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:48 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-03214d85-ebe7-4a11-8d4e-5c179c6141c6 tempest-CreateVolumesFromImageTest-1041778291 None] Created volume successfully. Sep 25 17:19:49 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131 1073741824" returned: 0 in 0.437s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:49 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131 Sep 25 17:19:49 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:49 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131" returned: 0 in 0.282s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.144s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-885174742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54bc36b2c2f74ce5b396dcb404b40c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:48Z,use_quota=True,user_id='04a22d23bdd245aead3e7653a19bfc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Creating volume 9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:19:49 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:49 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598 1073741824 Sep 25 17:19:49 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (866ae5bd-5960-43d8-a817-3082ba0cdbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2dbd3bb-fa0d-4947-a6b6-8edb8de0d2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:49 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Volume volume-bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131 (bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131): created successfully Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2dbd3bb-fa0d-4947-a6b6-8edb8de0d2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Flow 'volume_create_manager' (a00fe364-39f6-4385-b014-977d4a1d1786) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Flow 'volume_create_manager' (a22ff3e8-c1f5-4a59-a158-7f53a7ea5d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a24645-3bfb-4b2e-adf6-4eadbf3b63dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:49 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-a6905108-607a-4881-9cc7-3f29a3d3249c tempest-CreateVolumesFromImageTest-1041778291 None] Created volume successfully. Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a24645-3bfb-4b2e-adf6-4eadbf3b63dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1596498570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=39154d7f-0f14-402a-982e-6e929b948a08,host='devstack@QuobyteHD#QuobyteHD',id=4020b9e4-ecf0-4897-b58f-b484205b28b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5219a08490f24510b9d4df22c230bb1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:49Z,use_quota=True,user_id='a6eda45063714643b05e8e2cd4633f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01c761f2-0f51-4e22-9548-4b6386ad5621),volume_type_id=01c761f2-0f51-4e22-9548-4b6386ad5621)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8018fb8-ecf7-49ea-b3e0-d3f97da412f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8018fb8-ecf7-49ea-b3e0-d3f97da412f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2edc188-25de-4d52-b63a-e9cd84d4a139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2edc188-25de-4d52-b63a-e9cd84d4a139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4020b9e4-ecf0-4897-b58f-b484205b28b1', 'volume_name': 'volume-4020b9e4-ecf0-4897-b58f-b484205b28b1', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333bbe79-7762-42b8-9dcd-0913f88b2792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333bbe79-7762-42b8-9dcd-0913f88b2792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c43a9a83-040a-41a0-85d4-207b6479d061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:49 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Volume 4020b9e4-ecf0-4897-b58f-b484205b28b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4020b9e4-ecf0-4897-b58f-b484205b28b1', 'volume_size': 1} Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:49 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598 1073741824" returned: 0 in 0.517s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:50 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598 Sep 25 17:19:50 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:50 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598" returned: 0 in 0.250s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:19:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.713s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-482129217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503fb4df-9fdd-4268-9ecd-7403ff129bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54bc36b2c2f74ce5b396dcb404b40c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:48Z,use_quota=True,user_id='04a22d23bdd245aead3e7653a19bfc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:19:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Creating volume 503fb4df-9fdd-4268-9ecd-7403ff129bf0 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:19:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:19:50 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:19:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-503fb4df-9fdd-4268-9ecd-7403ff129bf0 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7058a3f-68c7-4af9-ab67-af64c9be6acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:50 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-503fb4df-9fdd-4268-9ecd-7403ff129bf0 1073741824 Sep 25 17:19:50 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2abc9b83-4dfa-4e05-bbf6-b88ae057aaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:50 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Volume volume-9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598 (9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598): created successfully Sep 25 17:19:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2abc9b83-4dfa-4e05-bbf6-b88ae057aaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Flow 'volume_create_manager' (7ecec464-5424-4f27-a4d4-a5360d983cb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:50 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b29b30fc-50b7-4c4c-a61d-fd2fa7b7a810 tempest-CreateVolumesFromImageTest-1041778291 None] Created volume successfully. Sep 25 17:19:50 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-503fb4df-9fdd-4268-9ecd-7403ff129bf0 1073741824" returned: 0 in 0.489s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-503fb4df-9fdd-4268-9ecd-7403ff129bf0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:50 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-503fb4df-9fdd-4268-9ecd-7403ff129bf0 Sep 25 17:19:50 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:51 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-503fb4df-9fdd-4268-9ecd-7403ff129bf0" returned: 0 in 0.298s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.455s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=39154d7f-0f14-402a-982e-6e929b948a08,created_at=2026-09-25T15:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1596498570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=39154d7f-0f14-402a-982e-6e929b948a08,host='devstack@QuobyteHD#QuobyteHD',id=4020b9e4-ecf0-4897-b58f-b484205b28b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5219a08490f24510b9d4df22c230bb1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:49Z,use_quota=True,user_id='a6eda45063714643b05e8e2cd4633f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01c761f2-0f51-4e22-9548-4b6386ad5621),volume_type_id=01c761f2-0f51-4e22-9548-4b6386ad5621)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Creating volume 4020b9e4-ecf0-4897-b58f-b484205b28b1 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:19:51 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190d7737-794b-47bd-9794-49138fe62c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-503fb4df-9fdd-4268-9ecd-7403ff129bf0', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:51 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1 1073741824 Sep 25 17:19:51 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7089918d-4644-430c-8496-0d21c2faea0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:51 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Volume volume-503fb4df-9fdd-4268-9ecd-7403ff129bf0 (503fb4df-9fdd-4268-9ecd-7403ff129bf0): created successfully Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7089918d-4644-430c-8496-0d21c2faea0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Flow 'volume_create_manager' (40a45d94-b8f2-41b3-a674-fd6d367ec8ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:51 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-bdad5f73-edef-4953-862d-f4beef9e68fb tempest-CreateVolumesFromImageTest-1041778291 None] Created volume successfully. Sep 25 17:19:51 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1 1073741824" returned: 0 in 0.466s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:51 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1 Sep 25 17:19:51 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:51 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1" returned: 0 in 0.263s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c43a9a83-040a-41a0-85d4-207b6479d061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4020b9e4-ecf0-4897-b58f-b484205b28b1', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c21e12-ff5f-4abf-9cd4-62bd16e2eb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:51 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Volume volume-4020b9e4-ecf0-4897-b58f-b484205b28b1 (4020b9e4-ecf0-4897-b58f-b484205b28b1): created successfully Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c21e12-ff5f-4abf-9cd4-62bd16e2eb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Flow 'volume_create_manager' (a22ff3e8-c1f5-4a59-a158-7f53a7ea5d18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:51 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-f1e02c4a-5944-497c-81f5-3a848d077b49 tempest-GroupSnapshotsV319Test-931860325 None] Created volume successfully. Sep 25 17:19:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-94eb7eb3-9b29-4d36-af98-eb6e5633de8c tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "cinder-503fb4df-9fdd-4268-9ecd-7403ff129bf0-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:52 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-94eb7eb3-9b29-4d36-af98-eb6e5633de8c tempest-CreateVolumesFromImageTest-1041778291 None] Lock "cinder-503fb4df-9fdd-4268-9ecd-7403ff129bf0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:52 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-94eb7eb3-9b29-4d36-af98-eb6e5633de8c tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "cinder-quobyte-503fb4df-9fdd-4268-9ecd-7403ff129bf0" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:52 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-94eb7eb3-9b29-4d36-af98-eb6e5633de8c tempest-CreateVolumesFromImageTest-1041778291 None] Lock "cinder-quobyte-503fb4df-9fdd-4268-9ecd-7403ff129bf0" acquired by "delete_volume" :: waited 0.017s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:52 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[17786dd3-e568-4f16-874b-6ac5d82506c0]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-94eb7eb3-9b29-4d36-af98-eb6e5633de8c tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-503fb4df-9fdd-4268-9ecd-7403ff129bf0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:52 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-503fb4df-9fdd-4268-9ecd-7403ff129bf0 Sep 25 17:19:52 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:52 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-94eb7eb3-9b29-4d36-af98-eb6e5633de8c tempest-CreateVolumesFromImageTest-1041778291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-503fb4df-9fdd-4268-9ecd-7403ff129bf0" returned: 0 in 0.365s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-94eb7eb3-9b29-4d36-af98-eb6e5633de8c tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-503fb4df-9fdd-4268-9ecd-7403ff129bf0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:52 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-503fb4df-9fdd-4268-9ecd-7403ff129bf0 Sep 25 17:19:52 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:52 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-94eb7eb3-9b29-4d36-af98-eb6e5633de8c tempest-CreateVolumesFromImageTest-1041778291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-503fb4df-9fdd-4268-9ecd-7403ff129bf0" returned: 0 in 0.325s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:52 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-94eb7eb3-9b29-4d36-af98-eb6e5633de8c tempest-CreateVolumesFromImageTest-1041778291 None] Lock "cinder-quobyte-503fb4df-9fdd-4268-9ecd-7403ff129bf0" released by "delete_volume" :: held 0.733s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:52 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-94eb7eb3-9b29-4d36-af98-eb6e5633de8c tempest-CreateVolumesFromImageTest-1041778291 None] Created reservations ['d60facec-74a2-437c-80d0-85294b9c0e2d', '2825ca89-0766-48bd-95de-64c39c663da9', '0849e2fb-62aa-43d6-83a4-e384aaf2dc42', '4c1358d4-6fcc-4c23-867f-4bced6acd370'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-94eb7eb3-9b29-4d36-af98-eb6e5633de8c tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-94eb7eb3-9b29-4d36-af98-eb6e5633de8c tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:52 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-94eb7eb3-9b29-4d36-af98-eb6e5633de8c tempest-CreateVolumesFromImageTest-1041778291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:52 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-94eb7eb3-9b29-4d36-af98-eb6e5633de8c tempest-CreateVolumesFromImageTest-1041778291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-94eb7eb3-9b29-4d36-af98-eb6e5633de8c tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-94eb7eb3-9b29-4d36-af98-eb6e5633de8c tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:52 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:19:52 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1183e59a-35eb-4568-be66-2833082afb31 tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "cinder-9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1183e59a-35eb-4568-be66-2833082afb31 tempest-CreateVolumesFromImageTest-1041778291 None] Lock "cinder-9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:53 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-94eb7eb3-9b29-4d36-af98-eb6e5633de8c tempest-CreateVolumesFromImageTest-1041778291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.347s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-94eb7eb3-9b29-4d36-af98-eb6e5633de8c tempest-CreateVolumesFromImageTest-1041778291 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:53 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-94eb7eb3-9b29-4d36-af98-eb6e5633de8c tempest-CreateVolumesFromImageTest-1041778291 None] Deleted volume successfully. Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1183e59a-35eb-4568-be66-2833082afb31 tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "cinder-quobyte-9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1183e59a-35eb-4568-be66-2833082afb31 tempest-CreateVolumesFromImageTest-1041778291 None] Lock "cinder-quobyte-9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598" acquired by "delete_volume" :: waited 0.017s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-94eb7eb3-9b29-4d36-af98-eb6e5633de8c tempest-CreateVolumesFromImageTest-1041778291 None] Lock "cinder-503fb4df-9fdd-4268-9ecd-7403ff129bf0-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d0fb6b-de62-46d9-a962-c0bfb8224221]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1183e59a-35eb-4568-be66-2833082afb31 tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:53 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598 Sep 25 17:19:53 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:53 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-f351035a-036f-4840-a912-851737d2b66f tempest-GroupSnapshotsV319Test-931860325 None] GroupSnapshot bf7dafa6-044e-46bc-8344-0f1f61cd4539: creating. Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f351035a-036f-4840-a912-851737d2b66f tempest-GroupSnapshotsV319Test-931860325 None] Group snapshot bf7dafa6-044e-46bc-8344-0f1f61cd4539: creating. {{(pid=87211) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f351035a-036f-4840-a912-851737d2b66f tempest-GroupSnapshotsV319Test-931860325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f351035a-036f-4840-a912-851737d2b66f tempest-GroupSnapshotsV319Test-931860325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-f351035a-036f-4840-a912-851737d2b66f tempest-GroupSnapshotsV319Test-931860325 None] Creating offline snapshot 03bc0936-7d0e-4f21-895d-e5c3e9d6037c of volume 4020b9e4-ecf0-4897-b58f-b484205b28b1 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[902d2805-557a-4dd9-8b5f-ec3d18b5dd8d]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f351035a-036f-4840-a912-851737d2b66f tempest-GroupSnapshotsV319Test-931860325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:53 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:19:53 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:53 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1 Sep 25 17:19:53 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:53 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1183e59a-35eb-4568-be66-2833082afb31 tempest-CreateVolumesFromImageTest-1041778291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598" returned: 0 in 0.524s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1183e59a-35eb-4568-be66-2833082afb31 tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:53 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598 Sep 25 17:19:53 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:54 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.365s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:54 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:54 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:19:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 28 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:19:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:19:54 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f351035a-036f-4840-a912-851737d2b66f tempest-GroupSnapshotsV319Test-931860325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1" returned: 0 in 0.476s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f351035a-036f-4840-a912-851737d2b66f tempest-GroupSnapshotsV319Test-931860325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.03bc0936-7d0e-4f21-895d-e5c3e9d6037c 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:54 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.03bc0936-7d0e-4f21-895d-e5c3e9d6037c 1G Sep 25 17:19:54 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:54 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1183e59a-35eb-4568-be66-2833082afb31 tempest-CreateVolumesFromImageTest-1041778291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598" returned: 0 in 0.374s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1183e59a-35eb-4568-be66-2833082afb31 tempest-CreateVolumesFromImageTest-1041778291 None] Lock "cinder-quobyte-9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598" released by "delete_volume" :: held 0.981s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:54 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-1183e59a-35eb-4568-be66-2833082afb31 tempest-CreateVolumesFromImageTest-1041778291 None] Created reservations ['53409b3c-9fae-462f-a446-89f864384ba6', '562a6312-c5e4-44c8-8694-b9a208dc8793', '5126241b-d4fc-4233-877f-8c4e6a07122d', 'b63bf59f-649f-4632-9e4b-80ed9132e04c'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1183e59a-35eb-4568-be66-2833082afb31 tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1183e59a-35eb-4568-be66-2833082afb31 tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1183e59a-35eb-4568-be66-2833082afb31 tempest-CreateVolumesFromImageTest-1041778291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1183e59a-35eb-4568-be66-2833082afb31 tempest-CreateVolumesFromImageTest-1041778291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1183e59a-35eb-4568-be66-2833082afb31 tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1183e59a-35eb-4568-be66-2833082afb31 tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:54 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:19:54 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:54 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f351035a-036f-4840-a912-851737d2b66f tempest-GroupSnapshotsV319Test-931860325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.03bc0936-7d0e-4f21-895d-e5c3e9d6037c 1G" returned: 0 in 0.684s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f351035a-036f-4840-a912-851737d2b66f tempest-GroupSnapshotsV319Test-931860325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4020b9e4-ecf0-4897-b58f-b484205b28b1 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.03bc0936-7d0e-4f21-895d-e5c3e9d6037c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:54 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4020b9e4-ecf0-4897-b58f-b484205b28b1 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.03bc0936-7d0e-4f21-895d-e5c3e9d6037c Sep 25 17:19:54 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:54 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1183e59a-35eb-4568-be66-2833082afb31 tempest-CreateVolumesFromImageTest-1041778291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.386s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:54 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-1183e59a-35eb-4568-be66-2833082afb31 tempest-CreateVolumesFromImageTest-1041778291 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:54 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-1183e59a-35eb-4568-be66-2833082afb31 tempest-CreateVolumesFromImageTest-1041778291 None] Deleted volume successfully. Sep 25 17:19:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1183e59a-35eb-4568-be66-2833082afb31 tempest-CreateVolumesFromImageTest-1041778291 None] Lock "cinder-9e74a07c-c9cf-4f59-a8bd-8ba2a7b6c598-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:55 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f351035a-036f-4840-a912-851737d2b66f tempest-GroupSnapshotsV319Test-931860325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4020b9e4-ecf0-4897-b58f-b484205b28b1 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.03bc0936-7d0e-4f21-895d-e5c3e9d6037c" returned: 0 in 0.398s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:55 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-f351035a-036f-4840-a912-851737d2b66f tempest-GroupSnapshotsV319Test-931860325 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.03bc0936-7d0e-4f21-895d-e5c3e9d6037c is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:19:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f351035a-036f-4840-a912-851737d2b66f tempest-GroupSnapshotsV319Test-931860325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.03bc0936-7d0e-4f21-895d-e5c3e9d6037c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:55 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.03bc0936-7d0e-4f21-895d-e5c3e9d6037c Sep 25 17:19:55 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-90b296d2-c63c-403e-91f6-e0407b9562af tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "cinder-bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-90b296d2-c63c-403e-91f6-e0407b9562af tempest-CreateVolumesFromImageTest-1041778291 None] Lock "cinder-bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-90b296d2-c63c-403e-91f6-e0407b9562af tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "cinder-quobyte-bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:55 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-90b296d2-c63c-403e-91f6-e0407b9562af tempest-CreateVolumesFromImageTest-1041778291 None] Lock "cinder-quobyte-bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131" acquired by "delete_volume" :: waited 0.024s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f351035a-036f-4840-a912-851737d2b66f tempest-GroupSnapshotsV319Test-931860325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.03bc0936-7d0e-4f21-895d-e5c3e9d6037c" returned: 0 in 0.560s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:55 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfaf2c1-11ee-4a38-abd3-911831603ea7]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-90b296d2-c63c-403e-91f6-e0407b9562af tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f351035a-036f-4840-a912-851737d2b66f tempest-GroupSnapshotsV319Test-931860325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:55 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.info Sep 25 17:19:55 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:56 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131 Sep 25 17:19:56 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:56 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f351035a-036f-4840-a912-851737d2b66f tempest-GroupSnapshotsV319Test-931860325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.info" returned: 0 in 0.390s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:56 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-f351035a-036f-4840-a912-851737d2b66f tempest-GroupSnapshotsV319Test-931860325 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:19:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f351035a-036f-4840-a912-851737d2b66f tempest-GroupSnapshotsV319Test-931860325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:56 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.info Sep 25 17:19:56 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:56 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-90b296d2-c63c-403e-91f6-e0407b9562af tempest-CreateVolumesFromImageTest-1041778291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131" returned: 0 in 0.600s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-90b296d2-c63c-403e-91f6-e0407b9562af tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:56 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131 Sep 25 17:19:56 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:56 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f351035a-036f-4840-a912-851737d2b66f tempest-GroupSnapshotsV319Test-931860325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.info" returned: 0 in 0.397s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f351035a-036f-4840-a912-851737d2b66f tempest-GroupSnapshotsV319Test-931860325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.032s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:56 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-8db9a84e-af4f-46eb-a7b5-c5749973c36f req-e38a77d2-2e60-4b13-ba3b-58ceec16c440 tempest-TestShelveInstance-1770032521 None] Terminate volume connection completed successfully. Sep 25 17:19:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-8db9a84e-af4f-46eb-a7b5-c5749973c36f req-e38a77d2-2e60-4b13-ba3b-58ceec16c440 tempest-TestShelveInstance-1770032521 None] Deleting attachment 0d8025a5-b7f5-4d5e-bfb5-244769321b25. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:19:56 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-f351035a-036f-4840-a912-851737d2b66f tempest-GroupSnapshotsV319Test-931860325 None] group_snapshot bf7dafa6-044e-46bc-8344-0f1f61cd4539: created successfully Sep 25 17:19:56 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-90b296d2-c63c-403e-91f6-e0407b9562af tempest-CreateVolumesFromImageTest-1041778291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131" returned: 0 in 0.368s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-90b296d2-c63c-403e-91f6-e0407b9562af tempest-CreateVolumesFromImageTest-1041778291 None] Lock "cinder-quobyte-bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131" released by "delete_volume" :: held 1.033s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:56 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-90b296d2-c63c-403e-91f6-e0407b9562af tempest-CreateVolumesFromImageTest-1041778291 None] Created reservations ['0807d1a7-422b-4d19-9136-8821591efb3b', '09f5b417-abc0-421f-8bbe-fc2bf3409d99', '4475c5ad-c61e-48ec-942c-1c69049ace03', 'ca8c3591-61bb-4541-8a91-9e5c8acd9f74'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-8db9a84e-af4f-46eb-a7b5-c5749973c36f req-235e0f84-a91f-4570-b957-5e973fdd0117 tempest-TestShelveInstance-1770032521 None] Acquiring lock "cinder-b43776fd-5ab3-457f-9c2f-bff450785044-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-8db9a84e-af4f-46eb-a7b5-c5749973c36f req-235e0f84-a91f-4570-b957-5e973fdd0117 tempest-TestShelveInstance-1770032521 None] Lock "cinder-b43776fd-5ab3-457f-9c2f-bff450785044-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-90b296d2-c63c-403e-91f6-e0407b9562af tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-90b296d2-c63c-403e-91f6-e0407b9562af tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-90b296d2-c63c-403e-91f6-e0407b9562af tempest-CreateVolumesFromImageTest-1041778291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-90b296d2-c63c-403e-91f6-e0407b9562af tempest-CreateVolumesFromImageTest-1041778291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-90b296d2-c63c-403e-91f6-e0407b9562af tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-90b296d2-c63c-403e-91f6-e0407b9562af tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:57 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:19:57 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-8db9a84e-af4f-46eb-a7b5-c5749973c36f req-235e0f84-a91f-4570-b957-5e973fdd0117 tempest-TestShelveInstance-1770032521 None] Acquiring lock "cinder-quobyte-b43776fd-5ab3-457f-9c2f-bff450785044" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-8db9a84e-af4f-46eb-a7b5-c5749973c36f req-235e0f84-a91f-4570-b957-5e973fdd0117 tempest-TestShelveInstance-1770032521 None] Lock "cinder-quobyte-b43776fd-5ab3-457f-9c2f-bff450785044" acquired by "delete_volume" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3d95f1-0eb0-4c0c-9181-2bb65d3e0d46]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-8db9a84e-af4f-46eb-a7b5-c5749973c36f req-235e0f84-a91f-4570-b957-5e973fdd0117 tempest-TestShelveInstance-1770032521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b43776fd-5ab3-457f-9c2f-bff450785044 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:57 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b43776fd-5ab3-457f-9c2f-bff450785044 Sep 25 17:19:57 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:57 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-90b296d2-c63c-403e-91f6-e0407b9562af tempest-CreateVolumesFromImageTest-1041778291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.343s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-90b296d2-c63c-403e-91f6-e0407b9562af tempest-CreateVolumesFromImageTest-1041778291 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:57 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-90b296d2-c63c-403e-91f6-e0407b9562af tempest-CreateVolumesFromImageTest-1041778291 None] Deleted volume successfully. Sep 25 17:19:57 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] group_snapshot bf7dafa6-044e-46bc-8344-0f1f61cd4539: deleting Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-90b296d2-c63c-403e-91f6-e0407b9562af tempest-CreateVolumesFromImageTest-1041778291 None] Lock "cinder-bec4dd5b-57ea-4a1c-ae3e-d2adc93f9131-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] group_snapshot bf7dafa6-044e-46bc-8344-0f1f61cd4539: deleting {{(pid=87211) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] Acquiring lock "cinder-quobyte-4020b9e4-ecf0-4897-b58f-b484205b28b1" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] Lock "cinder-quobyte-4020b9e4-ecf0-4897-b58f-b484205b28b1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] Acquiring lock "cinder-quobyte-03bc0936-7d0e-4f21-895d-e5c3e9d6037c" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] Lock "cinder-quobyte-03bc0936-7d0e-4f21-895d-e5c3e9d6037c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] Deleting offline snapshot 03bc0936-7d0e-4f21-895d-e5c3e9d6037c of volume 4020b9e4-ecf0-4897-b58f-b484205b28b1 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] snapshot_file for this snap is: volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.03bc0936-7d0e-4f21-895d-e5c3e9d6037c {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[3472f750-88f1-4055-97d8-1e2ce0712b0c]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.03bc0936-7d0e-4f21-895d-e5c3e9d6037c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:57 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-8db9a84e-af4f-46eb-a7b5-c5749973c36f req-235e0f84-a91f-4570-b957-5e973fdd0117 tempest-TestShelveInstance-1770032521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b43776fd-5ab3-457f-9c2f-bff450785044" returned: 0 in 0.526s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-8db9a84e-af4f-46eb-a7b5-c5749973c36f req-235e0f84-a91f-4570-b957-5e973fdd0117 tempest-TestShelveInstance-1770032521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b43776fd-5ab3-457f-9c2f-bff450785044 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:57 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b43776fd-5ab3-457f-9c2f-bff450785044 Sep 25 17:19:57 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:57 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.03bc0936-7d0e-4f21-895d-e5c3e9d6037c Sep 25 17:19:57 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3ea433f1-9ad0-4362-9bf0-bc8b43a52071 tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "cinder-eb12deab-fcf9-4682-a320-3fe8a2fe0133-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3ea433f1-9ad0-4362-9bf0-bc8b43a52071 tempest-CreateVolumesFromImageTest-1041778291 None] Lock "cinder-eb12deab-fcf9-4682-a320-3fe8a2fe0133-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:57 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-8db9a84e-af4f-46eb-a7b5-c5749973c36f req-235e0f84-a91f-4570-b957-5e973fdd0117 tempest-TestShelveInstance-1770032521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b43776fd-5ab3-457f-9c2f-bff450785044" returned: 0 in 0.346s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-8db9a84e-af4f-46eb-a7b5-c5749973c36f req-235e0f84-a91f-4570-b957-5e973fdd0117 tempest-TestShelveInstance-1770032521 None] Lock "cinder-quobyte-b43776fd-5ab3-457f-9c2f-bff450785044" released by "delete_volume" :: held 0.948s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3ea433f1-9ad0-4362-9bf0-bc8b43a52071 tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "cinder-quobyte-eb12deab-fcf9-4682-a320-3fe8a2fe0133" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3ea433f1-9ad0-4362-9bf0-bc8b43a52071 tempest-CreateVolumesFromImageTest-1041778291 None] Lock "cinder-quobyte-eb12deab-fcf9-4682-a320-3fe8a2fe0133" acquired by "delete_volume" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:58 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.03bc0936-7d0e-4f21-895d-e5c3e9d6037c" returned: 0 in 0.511s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4020b9e4-ecf0-4897-b58f-b484205b28b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f9456c-14c6-48a5-950d-d98e8ee5a5f5]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3ea433f1-9ad0-4362-9bf0-bc8b43a52071 tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-eb12deab-fcf9-4682-a320-3fe8a2fe0133 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee09ea13-0b75-4319-a521-176e19987e35]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG cinder.quota [req-8db9a84e-af4f-46eb-a7b5-c5749973c36f req-235e0f84-a91f-4570-b957-5e973fdd0117 tempest-TestShelveInstance-1770032521 None] Created reservations ['42ebc5aa-ff75-450d-b0d6-65bc4aba9eb5', '03c2dde6-78f4-4a9a-a077-b1b55b798491', '1eeb631a-5d4a-41eb-9c7c-7b6deff2b763', '25727695-05dc-49d6-87db-187ed3ba7f18'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:58 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-eb12deab-fcf9-4682-a320-3fe8a2fe0133 Sep 25 17:19:58 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:58 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1 Sep 25 17:19:58 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-8db9a84e-af4f-46eb-a7b5-c5749973c36f req-235e0f84-a91f-4570-b957-5e973fdd0117 tempest-TestShelveInstance-1770032521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-8db9a84e-af4f-46eb-a7b5-c5749973c36f req-235e0f84-a91f-4570-b957-5e973fdd0117 tempest-TestShelveInstance-1770032521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [req-8db9a84e-af4f-46eb-a7b5-c5749973c36f req-235e0f84-a91f-4570-b957-5e973fdd0117 tempest-TestShelveInstance-1770032521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [req-8db9a84e-af4f-46eb-a7b5-c5749973c36f req-235e0f84-a91f-4570-b957-5e973fdd0117 tempest-TestShelveInstance-1770032521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-8db9a84e-af4f-46eb-a7b5-c5749973c36f req-235e0f84-a91f-4570-b957-5e973fdd0117 tempest-TestShelveInstance-1770032521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-8db9a84e-af4f-46eb-a7b5-c5749973c36f req-235e0f84-a91f-4570-b957-5e973fdd0117 tempest-TestShelveInstance-1770032521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:58 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:19:58 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:58 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3ea433f1-9ad0-4362-9bf0-bc8b43a52071 tempest-CreateVolumesFromImageTest-1041778291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-eb12deab-fcf9-4682-a320-3fe8a2fe0133" returned: 0 in 0.489s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3ea433f1-9ad0-4362-9bf0-bc8b43a52071 tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-eb12deab-fcf9-4682-a320-3fe8a2fe0133 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:58 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-eb12deab-fcf9-4682-a320-3fe8a2fe0133 Sep 25 17:19:58 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:58 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:58 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [req-8db9a84e-af4f-46eb-a7b5-c5749973c36f req-235e0f84-a91f-4570-b957-5e973fdd0117 tempest-TestShelveInstance-1770032521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.304s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG cinder.manager [req-8db9a84e-af4f-46eb-a7b5-c5749973c36f req-235e0f84-a91f-4570-b957-5e973fdd0117 tempest-TestShelveInstance-1770032521 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1" returned: 0 in 0.536s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.03bc0936-7d0e-4f21-895d-e5c3e9d6037c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:58 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-8db9a84e-af4f-46eb-a7b5-c5749973c36f req-235e0f84-a91f-4570-b957-5e973fdd0117 tempest-TestShelveInstance-1770032521 None] Deleted volume successfully. Sep 25 17:19:58 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.03bc0936-7d0e-4f21-895d-e5c3e9d6037c Sep 25 17:19:58 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [req-8db9a84e-af4f-46eb-a7b5-c5749973c36f req-235e0f84-a91f-4570-b957-5e973fdd0117 tempest-TestShelveInstance-1770032521 None] Lock "cinder-b43776fd-5ab3-457f-9c2f-bff450785044-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:58 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3ea433f1-9ad0-4362-9bf0-bc8b43a52071 tempest-CreateVolumesFromImageTest-1041778291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-eb12deab-fcf9-4682-a320-3fe8a2fe0133" returned: 0 in 0.385s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3ea433f1-9ad0-4362-9bf0-bc8b43a52071 tempest-CreateVolumesFromImageTest-1041778291 None] Lock "cinder-quobyte-eb12deab-fcf9-4682-a320-3fe8a2fe0133" released by "delete_volume" :: held 0.940s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:59 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-3ea433f1-9ad0-4362-9bf0-bc8b43a52071 tempest-CreateVolumesFromImageTest-1041778291 None] Created reservations ['e7af4ddb-3ff8-4718-8247-079bdf4e63ea', '5e3353ca-f2e0-4e4c-aef3-1b4df86971eb', 'c486165a-479d-4dbe-9be6-84a06f1efbeb', '8ed5323d-5255-41cf-92b0-42fccdf98a1c'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:59 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.03bc0936-7d0e-4f21-895d-e5c3e9d6037c" returned: 0 in 0.426s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.03bc0936-7d0e-4f21-895d-e5c3e9d6037c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:59 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.03bc0936-7d0e-4f21-895d-e5c3e9d6037c Sep 25 17:19:59 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3ea433f1-9ad0-4362-9bf0-bc8b43a52071 tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3ea433f1-9ad0-4362-9bf0-bc8b43a52071 tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:59 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3ea433f1-9ad0-4362-9bf0-bc8b43a52071 tempest-CreateVolumesFromImageTest-1041778291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:59 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3ea433f1-9ad0-4362-9bf0-bc8b43a52071 tempest-CreateVolumesFromImageTest-1041778291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3ea433f1-9ad0-4362-9bf0-bc8b43a52071 tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3ea433f1-9ad0-4362-9bf0-bc8b43a52071 tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:59 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:19:59 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:59 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1.03bc0936-7d0e-4f21-895d-e5c3e9d6037c" returned: 0 in 0.317s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] Lock "cinder-quobyte-03bc0936-7d0e-4f21-895d-e5c3e9d6037c" released by "_delete_snapshot" :: held 1.950s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:59 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3ea433f1-9ad0-4362-9bf0-bc8b43a52071 tempest-CreateVolumesFromImageTest-1041778291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.304s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:59 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-3ea433f1-9ad0-4362-9bf0-bc8b43a52071 tempest-CreateVolumesFromImageTest-1041778291 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] Lock "cinder-quobyte-4020b9e4-ecf0-4897-b58f-b484205b28b1" released by "delete_snapshot" :: held 1.981s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:59 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-3ea433f1-9ad0-4362-9bf0-bc8b43a52071 tempest-CreateVolumesFromImageTest-1041778291 None] Deleted volume successfully. Sep 25 17:19:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3ea433f1-9ad0-4362-9bf0-bc8b43a52071 tempest-CreateVolumesFromImageTest-1041778291 None] Lock "cinder-eb12deab-fcf9-4682-a320-3fe8a2fe0133-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:59 devstack cinder-volume[87211]: WARNING cinder.quota [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2020182400 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2020182400, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:19:59 devstack cinder-volume[87211]: WARNING cinder.quota [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2020182400 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2020182400, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:19:59 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] Created reservations ['6a4202cc-7c2f-47e3-959d-ea0bfd8508db', 'f3cc9de1-6f22-4b3a-a906-9d63a10f2e96', '1f4f043d-292b-4b19-8e4d-bbd6460bf552', '19c209f0-f8d6-487e-9b3f-4c95bd0ea017'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:59 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-82b995f3-2523-48c0-8fcf-87b310668e41 tempest-GroupSnapshotsV319Test-931860325 None] group_snapshot bf7dafa6-044e-46bc-8344-0f1f61cd4539: deleted successfully Sep 25 17:20:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8c6c5a97-7d24-408f-adde-e1eb5cf30d1e tempest-GroupSnapshotsV319Test-931860325 None] Acquiring lock "cinder-quobyte-4020b9e4-ecf0-4897-b58f-b484205b28b1" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8c6c5a97-7d24-408f-adde-e1eb5cf30d1e tempest-GroupSnapshotsV319Test-931860325 None] Lock "cinder-quobyte-4020b9e4-ecf0-4897-b58f-b484205b28b1" acquired by "delete_volume" :: waited 0.021s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:00 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[00524538-0bf9-4f78-b153-79239d619e09]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8c6c5a97-7d24-408f-adde-e1eb5cf30d1e tempest-GroupSnapshotsV319Test-931860325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-50ecd93c-1f0b-4801-987d-8fe56af83c1a tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "cinder-590b9554-30ee-4ec7-8de3-e4fb4f379843-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-50ecd93c-1f0b-4801-987d-8fe56af83c1a tempest-CreateVolumesFromImageTest-1041778291 None] Lock "cinder-590b9554-30ee-4ec7-8de3-e4fb4f379843-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-50ecd93c-1f0b-4801-987d-8fe56af83c1a tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "cinder-quobyte-590b9554-30ee-4ec7-8de3-e4fb4f379843" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-50ecd93c-1f0b-4801-987d-8fe56af83c1a tempest-CreateVolumesFromImageTest-1041778291 None] Lock "cinder-quobyte-590b9554-30ee-4ec7-8de3-e4fb4f379843" acquired by "delete_volume" :: waited 0.026s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:00 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1 Sep 25 17:20:00 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:00 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b46888-2bbd-4d47-93f2-d915261d8dc9]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-50ecd93c-1f0b-4801-987d-8fe56af83c1a tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-590b9554-30ee-4ec7-8de3-e4fb4f379843 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:00 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-590b9554-30ee-4ec7-8de3-e4fb4f379843 Sep 25 17:20:00 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:00 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8c6c5a97-7d24-408f-adde-e1eb5cf30d1e tempest-GroupSnapshotsV319Test-931860325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1" returned: 0 in 0.475s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8c6c5a97-7d24-408f-adde-e1eb5cf30d1e tempest-GroupSnapshotsV319Test-931860325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:00 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1 Sep 25 17:20:00 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:00 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-50ecd93c-1f0b-4801-987d-8fe56af83c1a tempest-CreateVolumesFromImageTest-1041778291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-590b9554-30ee-4ec7-8de3-e4fb4f379843" returned: 0 in 0.415s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-50ecd93c-1f0b-4801-987d-8fe56af83c1a tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-590b9554-30ee-4ec7-8de3-e4fb4f379843 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:00 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-590b9554-30ee-4ec7-8de3-e4fb4f379843 Sep 25 17:20:00 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:00 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8c6c5a97-7d24-408f-adde-e1eb5cf30d1e tempest-GroupSnapshotsV319Test-931860325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4020b9e4-ecf0-4897-b58f-b484205b28b1" returned: 0 in 0.344s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8c6c5a97-7d24-408f-adde-e1eb5cf30d1e tempest-GroupSnapshotsV319Test-931860325 None] Lock "cinder-quobyte-4020b9e4-ecf0-4897-b58f-b484205b28b1" released by "delete_volume" :: held 0.966s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-8c6c5a97-7d24-408f-adde-e1eb5cf30d1e tempest-GroupSnapshotsV319Test-931860325 None] Created reservations ['6a730408-55de-40e9-b380-7215da5eef26'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:01 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-50ecd93c-1f0b-4801-987d-8fe56af83c1a tempest-CreateVolumesFromImageTest-1041778291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-590b9554-30ee-4ec7-8de3-e4fb4f379843" returned: 0 in 0.350s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:01 devstack cinder-volume[87211]: WARNING cinder.quota [None req-8c6c5a97-7d24-408f-adde-e1eb5cf30d1e tempest-GroupSnapshotsV319Test-931860325 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2020182400 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2020182400, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-50ecd93c-1f0b-4801-987d-8fe56af83c1a tempest-CreateVolumesFromImageTest-1041778291 None] Lock "cinder-quobyte-590b9554-30ee-4ec7-8de3-e4fb4f379843" released by "delete_volume" :: held 0.824s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-8c6c5a97-7d24-408f-adde-e1eb5cf30d1e tempest-GroupSnapshotsV319Test-931860325 None] Created reservations ['4b31a7bb-c903-4474-b044-364332a934fe', '086c576e-1495-4bd4-88a7-70c121a218bb', 'aaeb3436-c6d5-4949-8720-799b6ca4c69c', 'b2dc2176-8551-42c4-adc1-0e320b8d293d'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-50ecd93c-1f0b-4801-987d-8fe56af83c1a tempest-CreateVolumesFromImageTest-1041778291 None] Created reservations ['795c45d8-141b-4450-b628-2d7fa2eb19bf', 'a9c2346a-e85f-4b4e-9154-c25659e711b4', '5e2da904-e90d-4ebe-84f2-343aac50836e', '1aad7d62-86da-49d4-a2b2-7eb8b22588d3'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-50ecd93c-1f0b-4801-987d-8fe56af83c1a tempest-CreateVolumesFromImageTest-1041778291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-50ecd93c-1f0b-4801-987d-8fe56af83c1a tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-50ecd93c-1f0b-4801-987d-8fe56af83c1a tempest-CreateVolumesFromImageTest-1041778291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-50ecd93c-1f0b-4801-987d-8fe56af83c1a tempest-CreateVolumesFromImageTest-1041778291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-50ecd93c-1f0b-4801-987d-8fe56af83c1a tempest-CreateVolumesFromImageTest-1041778291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-50ecd93c-1f0b-4801-987d-8fe56af83c1a tempest-CreateVolumesFromImageTest-1041778291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8c6c5a97-7d24-408f-adde-e1eb5cf30d1e tempest-GroupSnapshotsV319Test-931860325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8c6c5a97-7d24-408f-adde-e1eb5cf30d1e tempest-GroupSnapshotsV319Test-931860325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8c6c5a97-7d24-408f-adde-e1eb5cf30d1e tempest-GroupSnapshotsV319Test-931860325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8c6c5a97-7d24-408f-adde-e1eb5cf30d1e tempest-GroupSnapshotsV319Test-931860325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8c6c5a97-7d24-408f-adde-e1eb5cf30d1e tempest-GroupSnapshotsV319Test-931860325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8c6c5a97-7d24-408f-adde-e1eb5cf30d1e tempest-GroupSnapshotsV319Test-931860325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:01 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:20:01 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:01 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:20:01 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:01 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8c6c5a97-7d24-408f-adde-e1eb5cf30d1e tempest-GroupSnapshotsV319Test-931860325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.450s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-8c6c5a97-7d24-408f-adde-e1eb5cf30d1e tempest-GroupSnapshotsV319Test-931860325 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:01 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:01 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-8c6c5a97-7d24-408f-adde-e1eb5cf30d1e tempest-GroupSnapshotsV319Test-931860325 None] Delete group completed successfully. Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-50ecd93c-1f0b-4801-987d-8fe56af83c1a tempest-CreateVolumesFromImageTest-1041778291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.507s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-50ecd93c-1f0b-4801-987d-8fe56af83c1a tempest-CreateVolumesFromImageTest-1041778291 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:01 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-50ecd93c-1f0b-4801-987d-8fe56af83c1a tempest-CreateVolumesFromImageTest-1041778291 None] Deleted volume successfully. Sep 25 17:20:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-50ecd93c-1f0b-4801-987d-8fe56af83c1a tempest-CreateVolumesFromImageTest-1041778291 None] Lock "cinder-590b9554-30ee-4ec7-8de3-e4fb4f379843-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:05 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:UPDATE=193,cinder:SELECT=146,cinder:DELETE=13,cinder:INSERT=47 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:20:05 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=151,cinder:INSERT=52,cinder:UPDATE=184,cinder:DELETE=16 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:20:05 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Flow 'volume_create_manager' (2ead457a-f5d8-407a-abba-90f45d8e9c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfef4a6d-8f03-42a6-962a-83dc8929fd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfef4a6d-8f03-42a6-962a-83dc8929fd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1478627641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8e5d8f-c634-41d6-9535-4a199fbdfd3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2427f0427deb47d09dc0b47764f12be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:06Z,use_quota=True,user_id='a4c6f487c7b44d0195320e609e6f4f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c4b88d-5c49-4101-b75e-d0589f580b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c4b88d-5c49-4101-b75e-d0589f580b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb6d34f-8625-4288-9062-6b49e87829d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb6d34f-8625-4288-9062-6b49e87829d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e8e5d8f-c634-41d6-9535-4a199fbdfd3d', 'volume_name': 'volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad25e96-7bff-4bd8-aae4-010bc687bc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad25e96-7bff-4bd8-aae4-010bc687bc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0342f1a-01f1-41e9-8be7-d51b111b25a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:05 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Volume 5e8e5d8f-c634-41d6-9535-4a199fbdfd3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d', 'volume_size': 1} Sep 25 17:20:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1478627641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8e5d8f-c634-41d6-9535-4a199fbdfd3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2427f0427deb47d09dc0b47764f12be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:06Z,use_quota=True,user_id='a4c6f487c7b44d0195320e609e6f4f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Creating volume 5e8e5d8f-c634-41d6-9535-4a199fbdfd3d {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:06 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:20:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:06 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d 1073741824 Sep 25 17:20:06 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:06 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d 1073741824" returned: 0 in 0.607s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:06 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d Sep 25 17:20:06 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:06 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d" returned: 0 in 0.311s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0342f1a-01f1-41e9-8be7-d51b111b25a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808217f2-0442-4a5a-962a-cd37bae61444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:07 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Volume volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d (5e8e5d8f-c634-41d6-9535-4a199fbdfd3d): created successfully Sep 25 17:20:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808217f2-0442-4a5a-962a-cd37bae61444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Flow 'volume_create_manager' (2ead457a-f5d8-407a-abba-90f45d8e9c85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:07 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-7b7dbf38-df4e-42a0-b6ea-230769ef4834 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Created volume successfully. Sep 25 17:20:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2e25b888-aa90-447d-b2d7-958e98bc7329 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2e25b888-aa90-447d-b2d7-958e98bc7329 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-2e25b888-aa90-447d-b2d7-958e98bc7329 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Creating offline snapshot 6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6 of volume 5e8e5d8f-c634-41d6-9535-4a199fbdfd3d {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:20:08 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[2615915f-db71-4d71-9404-fa8972be343f]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2e25b888-aa90-447d-b2d7-958e98bc7329 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:08 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d Sep 25 17:20:08 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:08 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2e25b888-aa90-447d-b2d7-958e98bc7329 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d" returned: 0 in 0.424s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2e25b888-aa90-447d-b2d7-958e98bc7329 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:08 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6 1G Sep 25 17:20:08 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:09 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2e25b888-aa90-447d-b2d7-958e98bc7329 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6 1G" returned: 0 in 0.570s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2e25b888-aa90-447d-b2d7-958e98bc7329 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:09 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6 Sep 25 17:20:09 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:09 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2e25b888-aa90-447d-b2d7-958e98bc7329 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6" returned: 0 in 0.409s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:09 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-2e25b888-aa90-447d-b2d7-958e98bc7329 tempest-CreateVolumesFromSnapshotTest-1520708227 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6 is being set with open permissions: ugo+rw Sep 25 17:20:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2e25b888-aa90-447d-b2d7-958e98bc7329 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:09 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6 Sep 25 17:20:09 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:09 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2e25b888-aa90-447d-b2d7-958e98bc7329 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6" returned: 0 in 0.301s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2e25b888-aa90-447d-b2d7-958e98bc7329 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:09 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.info Sep 25 17:20:09 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:10 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2e25b888-aa90-447d-b2d7-958e98bc7329 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.info" returned: 0 in 0.303s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:10 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-2e25b888-aa90-447d-b2d7-958e98bc7329 tempest-CreateVolumesFromSnapshotTest-1520708227 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.info is being set with open permissions: ugo+rw Sep 25 17:20:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2e25b888-aa90-447d-b2d7-958e98bc7329 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:10 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.info Sep 25 17:20:10 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:10 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2e25b888-aa90-447d-b2d7-958e98bc7329 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.info" returned: 0 in 0.334s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2e25b888-aa90-447d-b2d7-958e98bc7329 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.481s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:10 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-2e25b888-aa90-447d-b2d7-958e98bc7329 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Create snapshot completed successfully Sep 25 17:20:11 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Flow 'volume_create_manager' (93ec6538-722d-4efe-9703-8f6f8eaf2fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9c07e8-aa12-4b6f-94d1-2b2e90ecbb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9c07e8-aa12-4b6f-94d1-2b2e90ecbb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1463118513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55cfc9b0-b550-4ae7-b396-0cc5674dc891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2427f0427deb47d09dc0b47764f12be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:12Z,use_quota=True,user_id='a4c6f487c7b44d0195320e609e6f4f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad5c2bc-d530-404d-969b-9d56162e1b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad5c2bc-d530-404d-969b-9d56162e1b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b5bf4b-c27f-4c0b-ba99-cdefcddbead8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b5bf4b-c27f-4c0b-ba99-cdefcddbead8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55cfc9b0-b550-4ae7-b396-0cc5674dc891', 'volume_name': 'volume-55cfc9b0-b550-4ae7-b396-0cc5674dc891', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8556f1-673e-4aed-b5a6-d22516d65934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8556f1-673e-4aed-b5a6-d22516d65934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdad7c65-c903-45f3-bdd1-3d94408d911c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:12 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Volume 55cfc9b0-b550-4ae7-b396-0cc5674dc891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55cfc9b0-b550-4ae7-b396-0cc5674dc891', 'volume_size': 1} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1463118513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55cfc9b0-b550-4ae7-b396-0cc5674dc891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2427f0427deb47d09dc0b47764f12be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:12Z,use_quota=True,user_id='a4c6f487c7b44d0195320e609e6f4f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Creating volume 55cfc9b0-b550-4ae7-b396-0cc5674dc891 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:12 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-55cfc9b0-b550-4ae7-b396-0cc5674dc891 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:12 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-55cfc9b0-b550-4ae7-b396-0cc5674dc891 1073741824 Sep 25 17:20:12 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Flow 'volume_create_manager' (70079954-9c7a-4f04-9488-83e5dd31c8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3bc3bc-f1d1-4f9e-8d70-daee2254d61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3bc3bc-f1d1-4f9e-8d70-daee2254d61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2139128897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff889cf-a096-4774-95b6-b357c2053371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2427f0427deb47d09dc0b47764f12be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:12Z,use_quota=True,user_id='a4c6f487c7b44d0195320e609e6f4f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85145fe1-c32e-416b-9abc-76a404cdc77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85145fe1-c32e-416b-9abc-76a404cdc77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ce5fb1-5a3c-49e8-8904-c05934a3dcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ce5fb1-5a3c-49e8-8904-c05934a3dcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aff889cf-a096-4774-95b6-b357c2053371', 'volume_name': 'volume-aff889cf-a096-4774-95b6-b357c2053371', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee43f295-7937-43df-bf73-e2726e0bf708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee43f295-7937-43df-bf73-e2726e0bf708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5c47b6-3c91-4c3a-9824-b1a90a84351a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:12 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Volume aff889cf-a096-4774-95b6-b357c2053371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aff889cf-a096-4774-95b6-b357c2053371', 'volume_size': 1} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:12 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-55cfc9b0-b550-4ae7-b396-0cc5674dc891 1073741824" returned: 0 in 0.674s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-55cfc9b0-b550-4ae7-b396-0cc5674dc891 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:12 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:13 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-55cfc9b0-b550-4ae7-b396-0cc5674dc891 Sep 25 17:20:13 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Flow 'volume_create_manager' (c791a9ae-627c-4fb6-8a8f-e61a9fa24e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f886456-c5d8-4966-9ded-43eaf09d2c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f886456-c5d8-4966-9ded-43eaf09d2c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-225809199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24ba087d-96bd-4ac2-aa6f-40cde6773517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2427f0427deb47d09dc0b47764f12be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:13Z,use_quota=True,user_id='a4c6f487c7b44d0195320e609e6f4f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec123bd2-b420-41c1-91e2-e04254a1358b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec123bd2-b420-41c1-91e2-e04254a1358b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69685fb1-a542-4119-83cd-757503e7e3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69685fb1-a542-4119-83cd-757503e7e3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24ba087d-96bd-4ac2-aa6f-40cde6773517', 'volume_name': 'volume-24ba087d-96bd-4ac2-aa6f-40cde6773517', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9397ddfd-d7e6-47da-80a0-0415aa57837f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9397ddfd-d7e6-47da-80a0-0415aa57837f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a29244-efda-4c00-8366-a7ceebaef73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:13 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Volume 24ba087d-96bd-4ac2-aa6f-40cde6773517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24ba087d-96bd-4ac2-aa6f-40cde6773517', 'volume_size': 1} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:13 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Flow 'volume_create_manager' (c9f20060-3051-47bc-95b7-5607766dfdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12143ceb-8cf2-414a-a4d2-f01e1d0d9033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-55cfc9b0-b550-4ae7-b396-0cc5674dc891" returned: 0 in 0.572s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.974s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2139128897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff889cf-a096-4774-95b6-b357c2053371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2427f0427deb47d09dc0b47764f12be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:12Z,use_quota=True,user_id='a4c6f487c7b44d0195320e609e6f4f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Creating volume aff889cf-a096-4774-95b6-b357c2053371 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:13 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-aff889cf-a096-4774-95b6-b357c2053371 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12143ceb-8cf2-414a-a4d2-f01e1d0d9033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2026279446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6449cd3e-aa59-4941-bf91-56c3ed8c91a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2427f0427deb47d09dc0b47764f12be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:13Z,use_quota=True,user_id='a4c6f487c7b44d0195320e609e6f4f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302d47b3-29d9-40db-8def-444fff6d474b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302d47b3-29d9-40db-8def-444fff6d474b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:13 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-aff889cf-a096-4774-95b6-b357c2053371 1073741824 Sep 25 17:20:13 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41057f4-f70d-4673-a508-47f52ce95a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41057f4-f70d-4673-a508-47f52ce95a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6449cd3e-aa59-4941-bf91-56c3ed8c91a9', 'volume_name': 'volume-6449cd3e-aa59-4941-bf91-56c3ed8c91a9', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f513a180-0df3-4cf6-9607-00f28cb25d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f513a180-0df3-4cf6-9607-00f28cb25d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3231ce1-010d-45f9-9afc-76ee6542cef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:13 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Volume 6449cd3e-aa59-4941-bf91-56c3ed8c91a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6449cd3e-aa59-4941-bf91-56c3ed8c91a9', 'volume_size': 1} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdad7c65-c903-45f3-bdd1-3d94408d911c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55cfc9b0-b550-4ae7-b396-0cc5674dc891', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a9de80-7921-419e-8d01-dfe6f2fb0a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:13 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Volume volume-55cfc9b0-b550-4ae7-b396-0cc5674dc891 (55cfc9b0-b550-4ae7-b396-0cc5674dc891): created successfully Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a9de80-7921-419e-8d01-dfe6f2fb0a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Flow 'volume_create_manager' (93ec6538-722d-4efe-9703-8f6f8eaf2fbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:13 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-586b9aa5-f12d-4413-9dea-a5c7b91d32b6 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Created volume successfully. Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Flow 'volume_create_manager' (3dd32166-6dbc-4efa-9b78-7af97a1c9cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddcf7146-ad87-4750-a3a2-77311f334178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddcf7146-ad87-4750-a3a2-77311f334178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-766537447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2427f0427deb47d09dc0b47764f12be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:14Z,use_quota=True,user_id='a4c6f487c7b44d0195320e609e6f4f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85192869-f259-413e-b16a-d1898906ea2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85192869-f259-413e-b16a-d1898906ea2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ce05af-2401-4ca1-9dc1-84b3fdf10a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ce05af-2401-4ca1-9dc1-84b3fdf10a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2', 'volume_name': 'volume-80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f06eceb3-3f53-4012-9f95-8af1c8e5466e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f06eceb3-3f53-4012-9f95-8af1c8e5466e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ced67f2-9916-47f1-ba27-ea11c056bae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:14 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Volume 80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2', 'volume_size': 1} Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:14 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-aff889cf-a096-4774-95b6-b357c2053371 1073741824" returned: 0 in 0.697s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-aff889cf-a096-4774-95b6-b357c2053371 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:14 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-aff889cf-a096-4774-95b6-b357c2053371 Sep 25 17:20:14 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:14 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-aff889cf-a096-4774-95b6-b357c2053371" returned: 0 in 0.288s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.374s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-225809199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24ba087d-96bd-4ac2-aa6f-40cde6773517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2427f0427deb47d09dc0b47764f12be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:13Z,use_quota=True,user_id='a4c6f487c7b44d0195320e609e6f4f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Creating volume 24ba087d-96bd-4ac2-aa6f-40cde6773517 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:14 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24ba087d-96bd-4ac2-aa6f-40cde6773517 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:14 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24ba087d-96bd-4ac2-aa6f-40cde6773517 1073741824 Sep 25 17:20:14 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5c47b6-3c91-4c3a-9824-b1a90a84351a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aff889cf-a096-4774-95b6-b357c2053371', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1193a5d8-59c2-4045-8151-a7c23dba92d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:14 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Volume volume-aff889cf-a096-4774-95b6-b357c2053371 (aff889cf-a096-4774-95b6-b357c2053371): created successfully Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1193a5d8-59c2-4045-8151-a7c23dba92d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Flow 'volume_create_manager' (70079954-9c7a-4f04-9488-83e5dd31c8e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:14 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-11199257-2512-462c-9282-441fc1fb3198 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Created volume successfully. Sep 25 17:20:15 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24ba087d-96bd-4ac2-aa6f-40cde6773517 1073741824" returned: 0 in 0.507s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24ba087d-96bd-4ac2-aa6f-40cde6773517 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:15 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24ba087d-96bd-4ac2-aa6f-40cde6773517 Sep 25 17:20:15 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:15 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24ba087d-96bd-4ac2-aa6f-40cde6773517" returned: 0 in 0.295s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.819s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2026279446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6449cd3e-aa59-4941-bf91-56c3ed8c91a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2427f0427deb47d09dc0b47764f12be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:13Z,use_quota=True,user_id='a4c6f487c7b44d0195320e609e6f4f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Creating volume 6449cd3e-aa59-4941-bf91-56c3ed8c91a9 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:15 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:20:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6449cd3e-aa59-4941-bf91-56c3ed8c91a9 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:15 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6449cd3e-aa59-4941-bf91-56c3ed8c91a9 1073741824 Sep 25 17:20:15 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a29244-efda-4c00-8366-a7ceebaef73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24ba087d-96bd-4ac2-aa6f-40cde6773517', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb6c0c0-42a5-4248-b958-9bf0cd4e41f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:15 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Volume volume-24ba087d-96bd-4ac2-aa6f-40cde6773517 (24ba087d-96bd-4ac2-aa6f-40cde6773517): created successfully Sep 25 17:20:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb6c0c0-42a5-4248-b958-9bf0cd4e41f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Flow 'volume_create_manager' (c791a9ae-627c-4fb6-8a8f-e61a9fa24e5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:15 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b613aa92-cd6e-47a0-ad53-c4ef1f445066 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Created volume successfully. Sep 25 17:20:16 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6449cd3e-aa59-4941-bf91-56c3ed8c91a9 1073741824" returned: 0 in 0.585s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6449cd3e-aa59-4941-bf91-56c3ed8c91a9 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:16 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6449cd3e-aa59-4941-bf91-56c3ed8c91a9 Sep 25 17:20:16 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:16 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6449cd3e-aa59-4941-bf91-56c3ed8c91a9" returned: 0 in 0.302s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.355s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-766537447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2427f0427deb47d09dc0b47764f12be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:14Z,use_quota=True,user_id='a4c6f487c7b44d0195320e609e6f4f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Creating volume 80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:16 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:20:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3231ce1-010d-45f9-9afc-76ee6542cef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6449cd3e-aa59-4941-bf91-56c3ed8c91a9', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:16 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2 1073741824 Sep 25 17:20:16 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731428aa-8976-4de4-9e63-dba5eaa616da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:16 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Volume volume-6449cd3e-aa59-4941-bf91-56c3ed8c91a9 (6449cd3e-aa59-4941-bf91-56c3ed8c91a9): created successfully Sep 25 17:20:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731428aa-8976-4de4-9e63-dba5eaa616da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Flow 'volume_create_manager' (c9f20060-3051-47bc-95b7-5607766dfdd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:16 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-9e85cb1d-c006-4116-9def-b192c932a98f tempest-CreateVolumesFromSnapshotTest-1520708227 None] Created volume successfully. Sep 25 17:20:16 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2 1073741824" returned: 0 in 0.560s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:17 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2 Sep 25 17:20:17 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:17 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2" returned: 0 in 0.333s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ced67f2-9916-47f1-ba27-ea11c056bae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3acc9433-d1c2-4bfa-a507-2e9a073b182d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:17 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Volume volume-80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2 (80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2): created successfully Sep 25 17:20:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3acc9433-d1c2-4bfa-a507-2e9a073b182d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Flow 'volume_create_manager' (3dd32166-6dbc-4efa-9b78-7af97a1c9cc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:17 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-75fa66ef-b49f-4d9e-bb5f-f86a07816f78 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Created volume successfully. Sep 25 17:20:18 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4977feb6-3fe5-47f1-be08-1781cf0cbd6e tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "cinder-80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:18 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4977feb6-3fe5-47f1-be08-1781cf0cbd6e tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:18 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4977feb6-3fe5-47f1-be08-1781cf0cbd6e tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "cinder-quobyte-80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:18 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4977feb6-3fe5-47f1-be08-1781cf0cbd6e tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-quobyte-80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2" acquired by "delete_volume" :: waited 0.021s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:18 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[defccb7c-a642-4676-ab0c-02a6ce812a95]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4977feb6-3fe5-47f1-be08-1781cf0cbd6e tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:18 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2 Sep 25 17:20:18 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:19 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4977feb6-3fe5-47f1-be08-1781cf0cbd6e tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2" returned: 0 in 0.429s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4977feb6-3fe5-47f1-be08-1781cf0cbd6e tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:19 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2 Sep 25 17:20:19 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:19 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4977feb6-3fe5-47f1-be08-1781cf0cbd6e tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2" returned: 0 in 0.296s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4977feb6-3fe5-47f1-be08-1781cf0cbd6e tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-quobyte-80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2" released by "delete_volume" :: held 0.793s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:19 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-4977feb6-3fe5-47f1-be08-1781cf0cbd6e tempest-CreateVolumesFromSnapshotTest-1520708227 None] Created reservations ['e221a63c-1d08-4486-8fdb-fdb0561fc480', '7dbf25aa-d253-43c7-9349-853b4f282ea0', '960549ba-e990-4527-a1ff-f684337a02d5', 'f87f524c-e4f4-4fab-8484-9c30d1171810'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4977feb6-3fe5-47f1-be08-1781cf0cbd6e tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4977feb6-3fe5-47f1-be08-1781cf0cbd6e tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4977feb6-3fe5-47f1-be08-1781cf0cbd6e tempest-CreateVolumesFromSnapshotTest-1520708227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4977feb6-3fe5-47f1-be08-1781cf0cbd6e tempest-CreateVolumesFromSnapshotTest-1520708227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4977feb6-3fe5-47f1-be08-1781cf0cbd6e tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4977feb6-3fe5-47f1-be08-1781cf0cbd6e tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:19 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:20:19 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8771e42f-d2af-4ddb-a968-a2c04f9cdb10 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "cinder-6449cd3e-aa59-4941-bf91-56c3ed8c91a9-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8771e42f-d2af-4ddb-a968-a2c04f9cdb10 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-6449cd3e-aa59-4941-bf91-56c3ed8c91a9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8771e42f-d2af-4ddb-a968-a2c04f9cdb10 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "cinder-quobyte-6449cd3e-aa59-4941-bf91-56c3ed8c91a9" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8771e42f-d2af-4ddb-a968-a2c04f9cdb10 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-quobyte-6449cd3e-aa59-4941-bf91-56c3ed8c91a9" acquired by "delete_volume" :: waited 0.026s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:19 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab7548c-145a-43ec-b102-f204ff6f5857]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8771e42f-d2af-4ddb-a968-a2c04f9cdb10 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6449cd3e-aa59-4941-bf91-56c3ed8c91a9 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:20 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4977feb6-3fe5-47f1-be08-1781cf0cbd6e tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.387s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:20 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-4977feb6-3fe5-47f1-be08-1781cf0cbd6e tempest-CreateVolumesFromSnapshotTest-1520708227 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:20 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-4977feb6-3fe5-47f1-be08-1781cf0cbd6e tempest-CreateVolumesFromSnapshotTest-1520708227 None] Deleted volume successfully. Sep 25 17:20:20 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4977feb6-3fe5-47f1-be08-1781cf0cbd6e tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-80d5f3aa-d9f6-48d7-bc1e-f92bfeb0a3f2-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:20 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6449cd3e-aa59-4941-bf91-56c3ed8c91a9 Sep 25 17:20:20 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:20 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8771e42f-d2af-4ddb-a968-a2c04f9cdb10 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6449cd3e-aa59-4941-bf91-56c3ed8c91a9" returned: 0 in 0.433s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8771e42f-d2af-4ddb-a968-a2c04f9cdb10 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6449cd3e-aa59-4941-bf91-56c3ed8c91a9 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:20 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6449cd3e-aa59-4941-bf91-56c3ed8c91a9 Sep 25 17:20:20 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:20 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8771e42f-d2af-4ddb-a968-a2c04f9cdb10 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6449cd3e-aa59-4941-bf91-56c3ed8c91a9" returned: 0 in 0.335s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:20 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8771e42f-d2af-4ddb-a968-a2c04f9cdb10 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-quobyte-6449cd3e-aa59-4941-bf91-56c3ed8c91a9" released by "delete_volume" :: held 0.838s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:20 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-8771e42f-d2af-4ddb-a968-a2c04f9cdb10 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Created reservations ['16f92c6a-9d69-4d23-8a96-8e44f5081de5', '9a1cdd0f-eefd-4c0e-965d-60a27a4667df', '2c286c9c-63d9-47e9-8c65-c2ab2b07bca7', '7cc62bb1-2538-4dc1-92c9-25300d8b13bc'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8771e42f-d2af-4ddb-a968-a2c04f9cdb10 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8771e42f-d2af-4ddb-a968-a2c04f9cdb10 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:20 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8771e42f-d2af-4ddb-a968-a2c04f9cdb10 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:20 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8771e42f-d2af-4ddb-a968-a2c04f9cdb10 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8771e42f-d2af-4ddb-a968-a2c04f9cdb10 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8771e42f-d2af-4ddb-a968-a2c04f9cdb10 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:20 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:20:20 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b6e35a2b-296b-4ee3-98e4-c3f6e654c361 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "cinder-24ba087d-96bd-4ac2-aa6f-40cde6773517-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b6e35a2b-296b-4ee3-98e4-c3f6e654c361 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-24ba087d-96bd-4ac2-aa6f-40cde6773517-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b6e35a2b-296b-4ee3-98e4-c3f6e654c361 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "cinder-quobyte-24ba087d-96bd-4ac2-aa6f-40cde6773517" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b6e35a2b-296b-4ee3-98e4-c3f6e654c361 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-quobyte-24ba087d-96bd-4ac2-aa6f-40cde6773517" acquired by "delete_volume" :: waited 0.031s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:21 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e2fe65-bc23-4f23-8aae-f73c7fb0b505]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b6e35a2b-296b-4ee3-98e4-c3f6e654c361 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24ba087d-96bd-4ac2-aa6f-40cde6773517 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:21 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8771e42f-d2af-4ddb-a968-a2c04f9cdb10 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.323s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:21 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-8771e42f-d2af-4ddb-a968-a2c04f9cdb10 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:21 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-8771e42f-d2af-4ddb-a968-a2c04f9cdb10 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Deleted volume successfully. Sep 25 17:20:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8771e42f-d2af-4ddb-a968-a2c04f9cdb10 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-6449cd3e-aa59-4941-bf91-56c3ed8c91a9-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:21 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24ba087d-96bd-4ac2-aa6f-40cde6773517 Sep 25 17:20:21 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:21 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b6e35a2b-296b-4ee3-98e4-c3f6e654c361 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24ba087d-96bd-4ac2-aa6f-40cde6773517" returned: 0 in 0.545s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b6e35a2b-296b-4ee3-98e4-c3f6e654c361 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24ba087d-96bd-4ac2-aa6f-40cde6773517 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:21 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24ba087d-96bd-4ac2-aa6f-40cde6773517 Sep 25 17:20:21 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:22 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b6e35a2b-296b-4ee3-98e4-c3f6e654c361 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24ba087d-96bd-4ac2-aa6f-40cde6773517" returned: 0 in 0.304s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b6e35a2b-296b-4ee3-98e4-c3f6e654c361 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-quobyte-24ba087d-96bd-4ac2-aa6f-40cde6773517" released by "delete_volume" :: held 0.911s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:22 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-b6e35a2b-296b-4ee3-98e4-c3f6e654c361 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Created reservations ['6feb2cfa-4221-4b7d-9d49-5b3e6bb4ff4a', 'f2a7af71-2aa1-4777-9c5f-48022b436ba5', '2cd69bf9-9e00-41f2-8ff9-a648844e8de0', '1d2bf449-62ab-4aad-afee-6c221e4a696b'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b6e35a2b-296b-4ee3-98e4-c3f6e654c361 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b6e35a2b-296b-4ee3-98e4-c3f6e654c361 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b6e35a2b-296b-4ee3-98e4-c3f6e654c361 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b6e35a2b-296b-4ee3-98e4-c3f6e654c361 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b6e35a2b-296b-4ee3-98e4-c3f6e654c361 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b6e35a2b-296b-4ee3-98e4-c3f6e654c361 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:22 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:20:22 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d4f8b755-9775-40fb-ac6d-948060922597 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "cinder-aff889cf-a096-4774-95b6-b357c2053371-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d4f8b755-9775-40fb-ac6d-948060922597 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-aff889cf-a096-4774-95b6-b357c2053371-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d4f8b755-9775-40fb-ac6d-948060922597 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "cinder-quobyte-aff889cf-a096-4774-95b6-b357c2053371" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d4f8b755-9775-40fb-ac6d-948060922597 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-quobyte-aff889cf-a096-4774-95b6-b357c2053371" acquired by "delete_volume" :: waited 0.038s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:22 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1507e7-0877-42d3-b959-fbf297934b6d]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d4f8b755-9775-40fb-ac6d-948060922597 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-aff889cf-a096-4774-95b6-b357c2053371 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:22 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-aff889cf-a096-4774-95b6-b357c2053371 Sep 25 17:20:22 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:22 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b6e35a2b-296b-4ee3-98e4-c3f6e654c361 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.511s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:22 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-b6e35a2b-296b-4ee3-98e4-c3f6e654c361 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:22 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b6e35a2b-296b-4ee3-98e4-c3f6e654c361 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Deleted volume successfully. Sep 25 17:20:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b6e35a2b-296b-4ee3-98e4-c3f6e654c361 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-24ba087d-96bd-4ac2-aa6f-40cde6773517-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:23 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d4f8b755-9775-40fb-ac6d-948060922597 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-aff889cf-a096-4774-95b6-b357c2053371" returned: 0 in 0.527s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d4f8b755-9775-40fb-ac6d-948060922597 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-aff889cf-a096-4774-95b6-b357c2053371 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:23 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-aff889cf-a096-4774-95b6-b357c2053371 Sep 25 17:20:23 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:23 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d4f8b755-9775-40fb-ac6d-948060922597 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-aff889cf-a096-4774-95b6-b357c2053371" returned: 0 in 0.274s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d4f8b755-9775-40fb-ac6d-948060922597 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-quobyte-aff889cf-a096-4774-95b6-b357c2053371" released by "delete_volume" :: held 0.877s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:23 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-d4f8b755-9775-40fb-ac6d-948060922597 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Created reservations ['205ea3f2-942b-4d64-8bbd-768a4ac0cfdf', 'a99a9b94-c5b9-4f39-8a93-6644d2a62e32', 'e5d55645-1117-476f-a02f-689903cb3e2d', 'a2acb658-cc85-4251-bc0e-093dcd4f8793'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d4f8b755-9775-40fb-ac6d-948060922597 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d4f8b755-9775-40fb-ac6d-948060922597 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d4f8b755-9775-40fb-ac6d-948060922597 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d4f8b755-9775-40fb-ac6d-948060922597 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d4f8b755-9775-40fb-ac6d-948060922597 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d4f8b755-9775-40fb-ac6d-948060922597 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:23 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:20:23 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ebf807d8-4077-4daa-9159-95f181352bac tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "cinder-55cfc9b0-b550-4ae7-b396-0cc5674dc891-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ebf807d8-4077-4daa-9159-95f181352bac tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-55cfc9b0-b550-4ae7-b396-0cc5674dc891-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ebf807d8-4077-4daa-9159-95f181352bac tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "cinder-quobyte-55cfc9b0-b550-4ae7-b396-0cc5674dc891" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ebf807d8-4077-4daa-9159-95f181352bac tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-quobyte-55cfc9b0-b550-4ae7-b396-0cc5674dc891" acquired by "delete_volume" :: waited 0.021s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:23 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f133b2b-2bb5-49d2-86da-1101a626c6b0]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ebf807d8-4077-4daa-9159-95f181352bac tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-55cfc9b0-b550-4ae7-b396-0cc5674dc891 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:23 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-55cfc9b0-b550-4ae7-b396-0cc5674dc891 Sep 25 17:20:23 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:23 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d4f8b755-9775-40fb-ac6d-948060922597 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.370s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:23 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-d4f8b755-9775-40fb-ac6d-948060922597 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:23 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-d4f8b755-9775-40fb-ac6d-948060922597 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Deleted volume successfully. Sep 25 17:20:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d4f8b755-9775-40fb-ac6d-948060922597 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-aff889cf-a096-4774-95b6-b357c2053371-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:24 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ebf807d8-4077-4daa-9159-95f181352bac tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-55cfc9b0-b550-4ae7-b396-0cc5674dc891" returned: 0 in 0.424s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ebf807d8-4077-4daa-9159-95f181352bac tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-55cfc9b0-b550-4ae7-b396-0cc5674dc891 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:24 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-55cfc9b0-b550-4ae7-b396-0cc5674dc891 Sep 25 17:20:24 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:24 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ebf807d8-4077-4daa-9159-95f181352bac tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-55cfc9b0-b550-4ae7-b396-0cc5674dc891" returned: 0 in 0.296s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ebf807d8-4077-4daa-9159-95f181352bac tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-quobyte-55cfc9b0-b550-4ae7-b396-0cc5674dc891" released by "delete_volume" :: held 0.794s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:24 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-ebf807d8-4077-4daa-9159-95f181352bac tempest-CreateVolumesFromSnapshotTest-1520708227 None] Created reservations ['90608fc2-8a66-4b04-87ae-8db368de1d0c', '97f13572-ba12-4c1c-98a3-37c803efced9', 'c06835d4-5ace-40d4-b2b9-432fb60e866d', '9a1040aa-2084-4b69-8221-3fcb92fa7d6e'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ebf807d8-4077-4daa-9159-95f181352bac tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ebf807d8-4077-4daa-9159-95f181352bac tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ebf807d8-4077-4daa-9159-95f181352bac tempest-CreateVolumesFromSnapshotTest-1520708227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ebf807d8-4077-4daa-9159-95f181352bac tempest-CreateVolumesFromSnapshotTest-1520708227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ebf807d8-4077-4daa-9159-95f181352bac tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ebf807d8-4077-4daa-9159-95f181352bac tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:24 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:20:24 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-500492b4-7d2a-4d67-a6ae-1b555c79fc24 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "cinder-6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-500492b4-7d2a-4d67-a6ae-1b555c79fc24 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-500492b4-7d2a-4d67-a6ae-1b555c79fc24 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "cinder-quobyte-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-500492b4-7d2a-4d67-a6ae-1b555c79fc24 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-quobyte-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-500492b4-7d2a-4d67-a6ae-1b555c79fc24 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "cinder-quobyte-6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-500492b4-7d2a-4d67-a6ae-1b555c79fc24 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-quobyte-6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-500492b4-7d2a-4d67-a6ae-1b555c79fc24 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Deleting offline snapshot 6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6 of volume 5e8e5d8f-c634-41d6-9535-4a199fbdfd3d {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:20:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-500492b4-7d2a-4d67-a6ae-1b555c79fc24 tempest-CreateVolumesFromSnapshotTest-1520708227 None] snapshot_file for this snap is: volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:20:24 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[af18540d-6a4e-4458-bca9-79a047ffd5b8]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-500492b4-7d2a-4d67-a6ae-1b555c79fc24 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:25 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ebf807d8-4077-4daa-9159-95f181352bac tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.347s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:25 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-ebf807d8-4077-4daa-9159-95f181352bac tempest-CreateVolumesFromSnapshotTest-1520708227 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:25 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-ebf807d8-4077-4daa-9159-95f181352bac tempest-CreateVolumesFromSnapshotTest-1520708227 None] Deleted volume successfully. Sep 25 17:20:25 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6 Sep 25 17:20:25 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ebf807d8-4077-4daa-9159-95f181352bac tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-55cfc9b0-b550-4ae7-b396-0cc5674dc891-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:25 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-500492b4-7d2a-4d67-a6ae-1b555c79fc24 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6" returned: 0 in 0.485s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:25 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-500492b4-7d2a-4d67-a6ae-1b555c79fc24 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:20:25 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[94aac80c-f77a-4aad-8fba-ded4796c3579]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-500492b4-7d2a-4d67-a6ae-1b555c79fc24 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:25 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d Sep 25 17:20:25 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:25 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-500492b4-7d2a-4d67-a6ae-1b555c79fc24 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d" returned: 0 in 0.427s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-500492b4-7d2a-4d67-a6ae-1b555c79fc24 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:25 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6 Sep 25 17:20:25 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:26 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-500492b4-7d2a-4d67-a6ae-1b555c79fc24 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6" returned: 0 in 0.393s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-500492b4-7d2a-4d67-a6ae-1b555c79fc24 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:26 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6 Sep 25 17:20:26 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:26 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-500492b4-7d2a-4d67-a6ae-1b555c79fc24 tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d.6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6" returned: 0 in 0.294s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:26 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-500492b4-7d2a-4d67-a6ae-1b555c79fc24 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-quobyte-6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6" released by "_delete_snapshot" :: held 1.759s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:26 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-500492b4-7d2a-4d67-a6ae-1b555c79fc24 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-quobyte-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d" released by "delete_snapshot" :: held 1.787s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:26 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-500492b4-7d2a-4d67-a6ae-1b555c79fc24 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Created reservations ['b35983c0-e042-4dcf-b795-f60a0305d5af', '5264becc-84ed-49fe-a51c-4373a310a956', 'e7c47a56-e8db-43ab-9c8d-fe133057eab6', '4f258040-4dfa-4060-b8c7-f95474378f51'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:26 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-500492b4-7d2a-4d67-a6ae-1b555c79fc24 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Delete snapshot completed successfully. Sep 25 17:20:26 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-500492b4-7d2a-4d67-a6ae-1b555c79fc24 tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-6a4d8077-fb7b-4bba-9d6e-2eaf60c063e6-delete_snapshot" released by "delete_snapshot" :: held 1.958s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d481e62f-2c0b-4d9a-b27d-9bb7498f197c tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "cinder-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d481e62f-2c0b-4d9a-b27d-9bb7498f197c tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d481e62f-2c0b-4d9a-b27d-9bb7498f197c tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "cinder-quobyte-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d481e62f-2c0b-4d9a-b27d-9bb7498f197c tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-quobyte-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d" acquired by "delete_volume" :: waited 0.024s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:27 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbd8674-b424-4124-ad09-0f4e47cb2c02]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d481e62f-2c0b-4d9a-b27d-9bb7498f197c tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:27 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d Sep 25 17:20:27 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:27 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d481e62f-2c0b-4d9a-b27d-9bb7498f197c tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d" returned: 0 in 0.505s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d481e62f-2c0b-4d9a-b27d-9bb7498f197c tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:27 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d Sep 25 17:20:27 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:28 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d481e62f-2c0b-4d9a-b27d-9bb7498f197c tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d" returned: 0 in 0.301s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d481e62f-2c0b-4d9a-b27d-9bb7498f197c tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-quobyte-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d" released by "delete_volume" :: held 0.896s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:28 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-d481e62f-2c0b-4d9a-b27d-9bb7498f197c tempest-CreateVolumesFromSnapshotTest-1520708227 None] Created reservations ['d44c7a8a-5244-401c-9c99-20b21f3953e9', 'f2b5d590-a7c0-42f2-a161-1286d74af657', '8f76e1ea-2a0e-441f-b4b3-1767d01311dd', 'bfd33312-1e3b-40d6-8457-7840e6fc0bc3'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d481e62f-2c0b-4d9a-b27d-9bb7498f197c tempest-CreateVolumesFromSnapshotTest-1520708227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d481e62f-2c0b-4d9a-b27d-9bb7498f197c tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:28 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d481e62f-2c0b-4d9a-b27d-9bb7498f197c tempest-CreateVolumesFromSnapshotTest-1520708227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:28 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d481e62f-2c0b-4d9a-b27d-9bb7498f197c tempest-CreateVolumesFromSnapshotTest-1520708227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d481e62f-2c0b-4d9a-b27d-9bb7498f197c tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d481e62f-2c0b-4d9a-b27d-9bb7498f197c tempest-CreateVolumesFromSnapshotTest-1520708227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:28 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:20:28 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:28 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d481e62f-2c0b-4d9a-b27d-9bb7498f197c tempest-CreateVolumesFromSnapshotTest-1520708227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.313s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:28 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-d481e62f-2c0b-4d9a-b27d-9bb7498f197c tempest-CreateVolumesFromSnapshotTest-1520708227 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:28 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-d481e62f-2c0b-4d9a-b27d-9bb7498f197c tempest-CreateVolumesFromSnapshotTest-1520708227 None] Deleted volume successfully. Sep 25 17:20:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d481e62f-2c0b-4d9a-b27d-9bb7498f197c tempest-CreateVolumesFromSnapshotTest-1520708227 None] Lock "cinder-5e8e5d8f-c634-41d6-9535-4a199fbdfd3d-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Flow 'volume_create_manager' (59732c36-2002-4d61-8485-fef8942b6b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd937827-d20c-440c-b882-ce012bf39d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd937827-d20c-440c-b882-ce012bf39d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1657499149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dcd0548-6ea2-4246-964f-6a74ac622416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cb0f2567424b1ab2e06dd00950f671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:33Z,use_quota=True,user_id='f8195db49c734ea3839a313ce071b76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e8e098-3b2e-4294-aa02-458c6a678f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e8e098-3b2e-4294-aa02-458c6a678f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a70dd9f-5c72-42d4-bb24-1718373f49d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a70dd9f-5c72-42d4-bb24-1718373f49d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dcd0548-6ea2-4246-964f-6a74ac622416', 'volume_name': 'volume-0dcd0548-6ea2-4246-964f-6a74ac622416', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373536ab-b6b3-4f50-889d-9ef44a22aa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373536ab-b6b3-4f50-889d-9ef44a22aa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94712d2e-afbc-4517-8e58-cc00054576bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:32 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Volume 0dcd0548-6ea2-4246-964f-6a74ac622416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dcd0548-6ea2-4246-964f-6a74ac622416', 'volume_size': 1} Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1657499149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dcd0548-6ea2-4246-964f-6a74ac622416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cb0f2567424b1ab2e06dd00950f671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:33Z,use_quota=True,user_id='f8195db49c734ea3839a313ce071b76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Creating volume 0dcd0548-6ea2-4246-964f-6a74ac622416 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:32 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dcd0548-6ea2-4246-964f-6a74ac622416 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:32 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dcd0548-6ea2-4246-964f-6a74ac622416 1073741824 Sep 25 17:20:32 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Flow 'volume_create_manager' (5b09cbf2-17e1-42e0-b620-edb9663bf164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11422b6a-9fed-42ab-8af5-316a86f1793e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11422b6a-9fed-42ab-8af5-316a86f1793e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-42464329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244a3bc7-fc88-46b0-89a0-8e33b13547d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db9b93b9929f48e6881a96164a39eed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:33Z,use_quota=True,user_id='6cf074a275fc497f8074ce087438943d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cd7723f-82e2-4f0f-9c7f-bbf5115ff552),volume_type_id=3cd7723f-82e2-4f0f-9c7f-bbf5115ff552)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c548a757-47f6-4ed4-8254-7b89e9702853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c548a757-47f6-4ed4-8254-7b89e9702853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd224ff2-4ffc-4753-92e3-8f343516d2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd224ff2-4ffc-4753-92e3-8f343516d2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '244a3bc7-fc88-46b0-89a0-8e33b13547d5', 'volume_name': 'volume-244a3bc7-fc88-46b0-89a0-8e33b13547d5', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0243181d-ffbc-4acf-9c72-6616d89d0a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0243181d-ffbc-4acf-9c72-6616d89d0a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (380a74a1-a0af-41a4-8939-da677db09594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:33 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Volume 244a3bc7-fc88-46b0-89a0-8e33b13547d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-244a3bc7-fc88-46b0-89a0-8e33b13547d5', 'volume_size': 1} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:33 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dcd0548-6ea2-4246-964f-6a74ac622416 1073741824" returned: 0 in 0.532s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dcd0548-6ea2-4246-964f-6a74ac622416 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:33 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dcd0548-6ea2-4246-964f-6a74ac622416 Sep 25 17:20:33 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:33 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dcd0548-6ea2-4246-964f-6a74ac622416" returned: 0 in 0.304s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.567s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-42464329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244a3bc7-fc88-46b0-89a0-8e33b13547d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db9b93b9929f48e6881a96164a39eed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:33Z,use_quota=True,user_id='6cf074a275fc497f8074ce087438943d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cd7723f-82e2-4f0f-9c7f-bbf5115ff552),volume_type_id=3cd7723f-82e2-4f0f-9c7f-bbf5115ff552)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Creating volume 244a3bc7-fc88-46b0-89a0-8e33b13547d5 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:33 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-244a3bc7-fc88-46b0-89a0-8e33b13547d5 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94712d2e-afbc-4517-8e58-cc00054576bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dcd0548-6ea2-4246-964f-6a74ac622416', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:33 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-244a3bc7-fc88-46b0-89a0-8e33b13547d5 1073741824 Sep 25 17:20:33 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47344631-45b2-48d8-8e82-cfefe60cc905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:33 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Volume volume-0dcd0548-6ea2-4246-964f-6a74ac622416 (0dcd0548-6ea2-4246-964f-6a74ac622416): created successfully Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47344631-45b2-48d8-8e82-cfefe60cc905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Flow 'volume_create_manager' (59732c36-2002-4d61-8485-fef8942b6b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:33 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-289a206b-4068-4dae-8bd6-50030c9dc94e tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Created volume successfully. Sep 25 17:20:34 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-244a3bc7-fc88-46b0-89a0-8e33b13547d5 1073741824" returned: 0 in 0.584s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-244a3bc7-fc88-46b0-89a0-8e33b13547d5 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:34 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-244a3bc7-fc88-46b0-89a0-8e33b13547d5 Sep 25 17:20:34 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:34 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-244a3bc7-fc88-46b0-89a0-8e33b13547d5" returned: 0 in 0.301s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:34 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (380a74a1-a0af-41a4-8939-da677db09594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-244a3bc7-fc88-46b0-89a0-8e33b13547d5', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:34 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbfea489-b65d-4890-9433-7f5fd59886df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:34 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Volume volume-244a3bc7-fc88-46b0-89a0-8e33b13547d5 (244a3bc7-fc88-46b0-89a0-8e33b13547d5): created successfully Sep 25 17:20:34 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbfea489-b65d-4890-9433-7f5fd59886df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:34 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Flow 'volume_create_manager' (5b09cbf2-17e1-42e0-b620-edb9663bf164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:34 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-60e3d32b-7c9f-47af-80cf-f7ac6aa72d34 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Created volume successfully. Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Flow 'volume_create_manager' (70b897be-4b36-4650-9938-480989fd6d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fdd4527-acf6-44a0-ac82-d4d7ee0ba0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fdd4527-acf6-44a0-ac82-d4d7ee0ba0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1412392522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97b74654-5819-4926-8c52-46939a8dfb49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cb0f2567424b1ab2e06dd00950f671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:35Z,use_quota=True,user_id='f8195db49c734ea3839a313ce071b76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f4d5ec-ac81-4221-abe9-884cd4f72a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f4d5ec-ac81-4221-abe9-884cd4f72a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2ae006-c149-4720-9fa4-43e884a605ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2ae006-c149-4720-9fa4-43e884a605ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97b74654-5819-4926-8c52-46939a8dfb49', 'volume_name': 'volume-97b74654-5819-4926-8c52-46939a8dfb49', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef20d7e-46f5-49af-bf90-f1c21b1fd058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef20d7e-46f5-49af-bf90-f1c21b1fd058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a20f448-7b2c-48fa-9cd4-0da303c92c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:35 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Volume 97b74654-5819-4926-8c52-46939a8dfb49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97b74654-5819-4926-8c52-46939a8dfb49', 'volume_size': 1} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1412392522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97b74654-5819-4926-8c52-46939a8dfb49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cb0f2567424b1ab2e06dd00950f671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:35Z,use_quota=True,user_id='f8195db49c734ea3839a313ce071b76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Creating volume 97b74654-5819-4926-8c52-46939a8dfb49 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:35 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97b74654-5819-4926-8c52-46939a8dfb49 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:35 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97b74654-5819-4926-8c52-46939a8dfb49 1073741824 Sep 25 17:20:35 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Flow 'volume_create_manager' (8dedf854-38f3-4d88-9ca7-be0017267066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2622e66e-982d-46a6-84f5-54825b5cbdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2622e66e-982d-46a6-84f5-54825b5cbdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-929069207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6239ac13-f41c-46bc-84d1-419f0d9ca666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cb0f2567424b1ab2e06dd00950f671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:36Z,use_quota=True,user_id='f8195db49c734ea3839a313ce071b76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01b4030-6bd5-46a8-a8ec-45af10ebae46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01b4030-6bd5-46a8-a8ec-45af10ebae46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61727a8c-8876-4fc5-b3a3-f5bb0433ea4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61727a8c-8876-4fc5-b3a3-f5bb0433ea4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6239ac13-f41c-46bc-84d1-419f0d9ca666', 'volume_name': 'volume-6239ac13-f41c-46bc-84d1-419f0d9ca666', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eba2a5a-ba23-4876-aa45-a98fc81e0c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eba2a5a-ba23-4876-aa45-a98fc81e0c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a025def-1e5b-431b-9d2a-1e666b317aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:36 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Volume 6239ac13-f41c-46bc-84d1-419f0d9ca666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6239ac13-f41c-46bc-84d1-419f0d9ca666', 'volume_size': 1} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e81d4a81-99e4-4faa-a991-ee77ca35d30d tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e81d4a81-99e4-4faa-a991-ee77ca35d30d tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e81d4a81-99e4-4faa-a991-ee77ca35d30d tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e81d4a81-99e4-4faa-a991-ee77ca35d30d tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e81d4a81-99e4-4faa-a991-ee77ca35d30d tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e81d4a81-99e4-4faa-a991-ee77ca35d30d tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:36 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:20:36 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:36 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e81d4a81-99e4-4faa-a991-ee77ca35d30d tempest-VolumeRetypeWithoutMigrationTest-423369159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.363s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-e81d4a81-99e4-4faa-a991-ee77ca35d30d tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:36 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-e81d4a81-99e4-4faa-a991-ee77ca35d30d tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Retype volume completed successfully. Sep 25 17:20:36 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97b74654-5819-4926-8c52-46939a8dfb49 1073741824" returned: 0 in 0.882s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Flow 'volume_create_manager' (b3c8652b-691f-4266-b17c-0a822522b25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d4e55b-c725-4881-831b-ee56f15bec15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d4e55b-c725-4881-831b-ee56f15bec15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-655734585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe5bb8b-87dc-4f31-900b-8290077c2b29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cb0f2567424b1ab2e06dd00950f671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:36Z,use_quota=True,user_id='f8195db49c734ea3839a313ce071b76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dbb1dc7-9d3b-4e3d-bb51-daf3f2bb6ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dbb1dc7-9d3b-4e3d-bb51-daf3f2bb6ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c90dae9-e0ad-46b8-9e66-7d179fe9f333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c90dae9-e0ad-46b8-9e66-7d179fe9f333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffe5bb8b-87dc-4f31-900b-8290077c2b29', 'volume_name': 'volume-ffe5bb8b-87dc-4f31-900b-8290077c2b29', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90e7c4b-aef4-4f6a-8c9c-f22deef49e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90e7c4b-aef4-4f6a-8c9c-f22deef49e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726a2cf8-fa88-4b12-a625-e1030d3aeed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:36 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Volume ffe5bb8b-87dc-4f31-900b-8290077c2b29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffe5bb8b-87dc-4f31-900b-8290077c2b29', 'volume_size': 1} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97b74654-5819-4926-8c52-46939a8dfb49 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:36 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97b74654-5819-4926-8c52-46939a8dfb49 Sep 25 17:20:36 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Flow 'volume_create_manager' (d6168ef6-d361-4c43-8f18-0769c49047d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725495c9-3749-47bf-98c9-23276df10d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:37 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725495c9-3749-47bf-98c9-23276df10d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1153540804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc526865-b1d4-4f15-aaa9-12ea18ba2dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cb0f2567424b1ab2e06dd00950f671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:37Z,use_quota=True,user_id='f8195db49c734ea3839a313ce071b76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288003be-76b0-47b9-8e6c-3c20b08ca035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288003be-76b0-47b9-8e6c-3c20b08ca035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace7199e-75e1-4470-bf25-00d3179c0463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace7199e-75e1-4470-bf25-00d3179c0463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc526865-b1d4-4f15-aaa9-12ea18ba2dcc', 'volume_name': 'volume-dc526865-b1d4-4f15-aaa9-12ea18ba2dcc', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5b4ef6-87ed-4be9-abc7-72d392a57a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5b4ef6-87ed-4be9-abc7-72d392a57a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c754e9-e3cb-4cbe-8064-ee3ca358391b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:37 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Volume dc526865-b1d4-4f15-aaa9-12ea18ba2dcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc526865-b1d4-4f15-aaa9-12ea18ba2dcc', 'volume_size': 1} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-74d44cc3-185e-44e3-b974-afc017740fb9 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Acquiring lock "cinder-244a3bc7-fc88-46b0-89a0-8e33b13547d5-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97b74654-5819-4926-8c52-46939a8dfb49" returned: 0 in 0.498s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.305s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-929069207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6239ac13-f41c-46bc-84d1-419f0d9ca666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cb0f2567424b1ab2e06dd00950f671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:36Z,use_quota=True,user_id='f8195db49c734ea3839a313ce071b76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Creating volume 6239ac13-f41c-46bc-84d1-419f0d9ca666 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:37 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6239ac13-f41c-46bc-84d1-419f0d9ca666 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:37 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6239ac13-f41c-46bc-84d1-419f0d9ca666 1073741824 Sep 25 17:20:37 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-74d44cc3-185e-44e3-b974-afc017740fb9 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Lock "cinder-244a3bc7-fc88-46b0-89a0-8e33b13547d5-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a20f448-7b2c-48fa-9cd4-0da303c92c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97b74654-5819-4926-8c52-46939a8dfb49', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3adc3cc0-7417-4dbf-9aca-594893d254c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:37 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Volume volume-97b74654-5819-4926-8c52-46939a8dfb49 (97b74654-5819-4926-8c52-46939a8dfb49): created successfully Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3adc3cc0-7417-4dbf-9aca-594893d254c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Flow 'volume_create_manager' (70b897be-4b36-4650-9938-480989fd6d15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:37 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-57771edb-03b2-4e24-a177-acdd1b82660d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Created volume successfully. Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Flow 'volume_create_manager' (897b249f-7d30-4416-a17f-2b875df5f608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487e11c4-686a-40e3-aa2a-41c7c8271b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-74d44cc3-185e-44e3-b974-afc017740fb9 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Acquiring lock "cinder-quobyte-244a3bc7-fc88-46b0-89a0-8e33b13547d5" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487e11c4-686a-40e3-aa2a-41c7c8271b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-601074108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b757dd07-0adf-4267-bf62-47a7225b8286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cb0f2567424b1ab2e06dd00950f671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:37Z,use_quota=True,user_id='f8195db49c734ea3839a313ce071b76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a6363f-3bce-49c9-b984-d9b1af74ab7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a6363f-3bce-49c9-b984-d9b1af74ab7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd488bd1-56dd-44c8-9286-899d30bd5344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd488bd1-56dd-44c8-9286-899d30bd5344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b757dd07-0adf-4267-bf62-47a7225b8286', 'volume_name': 'volume-b757dd07-0adf-4267-bf62-47a7225b8286', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba406fc1-a313-4e55-a76c-56d76620ad80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba406fc1-a313-4e55-a76c-56d76620ad80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d3cad82-ea58-4137-88cb-e1c054f49409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:37 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Volume b757dd07-0adf-4267-bf62-47a7225b8286: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b757dd07-0adf-4267-bf62-47a7225b8286', 'volume_size': 1} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-74d44cc3-185e-44e3-b974-afc017740fb9 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Lock "cinder-quobyte-244a3bc7-fc88-46b0-89a0-8e33b13547d5" acquired by "delete_volume" :: waited 0.074s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49ac4ce-8e48-4888-bb43-832f3bd16304]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-74d44cc3-185e-44e3-b974-afc017740fb9 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-244a3bc7-fc88-46b0-89a0-8e33b13547d5 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:37 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-244a3bc7-fc88-46b0-89a0-8e33b13547d5 Sep 25 17:20:37 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:37 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6239ac13-f41c-46bc-84d1-419f0d9ca666 1073741824" returned: 0 in 0.549s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6239ac13-f41c-46bc-84d1-419f0d9ca666 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:37 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6239ac13-f41c-46bc-84d1-419f0d9ca666 Sep 25 17:20:37 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:38 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-74d44cc3-185e-44e3-b974-afc017740fb9 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-244a3bc7-fc88-46b0-89a0-8e33b13547d5" returned: 0 in 0.455s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-74d44cc3-185e-44e3-b974-afc017740fb9 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-244a3bc7-fc88-46b0-89a0-8e33b13547d5 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:38 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-244a3bc7-fc88-46b0-89a0-8e33b13547d5 Sep 25 17:20:38 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:38 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6239ac13-f41c-46bc-84d1-419f0d9ca666" returned: 0 in 0.286s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.415s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-655734585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe5bb8b-87dc-4f31-900b-8290077c2b29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cb0f2567424b1ab2e06dd00950f671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:36Z,use_quota=True,user_id='f8195db49c734ea3839a313ce071b76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Creating volume ffe5bb8b-87dc-4f31-900b-8290077c2b29 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:38 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ffe5bb8b-87dc-4f31-900b-8290077c2b29 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a025def-1e5b-431b-9d2a-1e666b317aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6239ac13-f41c-46bc-84d1-419f0d9ca666', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:38 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ffe5bb8b-87dc-4f31-900b-8290077c2b29 1073741824 Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bdd3bcd-eaed-4cb1-95e8-9de61e2e7bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:38 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:38 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Volume volume-6239ac13-f41c-46bc-84d1-419f0d9ca666 (6239ac13-f41c-46bc-84d1-419f0d9ca666): created successfully Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bdd3bcd-eaed-4cb1-95e8-9de61e2e7bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Flow 'volume_create_manager' (8dedf854-38f3-4d88-9ca7-be0017267066) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:38 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-8f4792ab-1ae9-477c-a2f7-0b2ffddf213f tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Created volume successfully. Sep 25 17:20:38 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-74d44cc3-185e-44e3-b974-afc017740fb9 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-244a3bc7-fc88-46b0-89a0-8e33b13547d5" returned: 0 in 0.320s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-74d44cc3-185e-44e3-b974-afc017740fb9 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Lock "cinder-quobyte-244a3bc7-fc88-46b0-89a0-8e33b13547d5" released by "delete_volume" :: held 0.833s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:38 devstack cinder-volume[87211]: WARNING cinder.quota [None req-74d44cc3-185e-44e3-b974-afc017740fb9 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:20:38 devstack cinder-volume[87211]: WARNING cinder.quota [None req-74d44cc3-185e-44e3-b974-afc017740fb9 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-74d44cc3-185e-44e3-b974-afc017740fb9 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Created reservations ['cc6138df-ec42-4045-befe-c2dd73790a2f', '6fc6cbbd-3382-4f39-a345-5dd114dadc61', '48ba46e2-a3c3-49d6-91e2-19d5302e9c84', 'b73e2aa0-c3ec-420e-a732-09c35267126b'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-74d44cc3-185e-44e3-b974-afc017740fb9 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-74d44cc3-185e-44e3-b974-afc017740fb9 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-74d44cc3-185e-44e3-b974-afc017740fb9 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-74d44cc3-185e-44e3-b974-afc017740fb9 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-74d44cc3-185e-44e3-b974-afc017740fb9 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-74d44cc3-185e-44e3-b974-afc017740fb9 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:38 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:20:38 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:38 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ffe5bb8b-87dc-4f31-900b-8290077c2b29 1073741824" returned: 0 in 0.624s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ffe5bb8b-87dc-4f31-900b-8290077c2b29 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:38 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ffe5bb8b-87dc-4f31-900b-8290077c2b29 Sep 25 17:20:38 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:38 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-74d44cc3-185e-44e3-b974-afc017740fb9 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.297s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:38 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-74d44cc3-185e-44e3-b974-afc017740fb9 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:38 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-74d44cc3-185e-44e3-b974-afc017740fb9 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Deleted volume successfully. Sep 25 17:20:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-74d44cc3-185e-44e3-b974-afc017740fb9 tempest-VolumeRetypeWithoutMigrationTest-423369159 None] Lock "cinder-244a3bc7-fc88-46b0-89a0-8e33b13547d5-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:39 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ffe5bb8b-87dc-4f31-900b-8290077c2b29" returned: 0 in 0.294s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.885s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1153540804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc526865-b1d4-4f15-aaa9-12ea18ba2dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cb0f2567424b1ab2e06dd00950f671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:37Z,use_quota=True,user_id='f8195db49c734ea3839a313ce071b76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Creating volume dc526865-b1d4-4f15-aaa9-12ea18ba2dcc {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:39 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:20:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-dc526865-b1d4-4f15-aaa9-12ea18ba2dcc 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726a2cf8-fa88-4b12-a625-e1030d3aeed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffe5bb8b-87dc-4f31-900b-8290077c2b29', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:39 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-dc526865-b1d4-4f15-aaa9-12ea18ba2dcc 1073741824 Sep 25 17:20:39 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81dd7236-6a1b-43ab-bf61-7d575f070e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:39 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Volume volume-ffe5bb8b-87dc-4f31-900b-8290077c2b29 (ffe5bb8b-87dc-4f31-900b-8290077c2b29): created successfully Sep 25 17:20:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81dd7236-6a1b-43ab-bf61-7d575f070e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Flow 'volume_create_manager' (b3c8652b-691f-4266-b17c-0a822522b25d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:39 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-63a1a3c7-9308-4f53-82dd-3764147c228d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Created volume successfully. Sep 25 17:20:39 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-dc526865-b1d4-4f15-aaa9-12ea18ba2dcc 1073741824" returned: 0 in 0.626s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-dc526865-b1d4-4f15-aaa9-12ea18ba2dcc {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:39 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-dc526865-b1d4-4f15-aaa9-12ea18ba2dcc Sep 25 17:20:39 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:40 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-dc526865-b1d4-4f15-aaa9-12ea18ba2dcc" returned: 0 in 0.307s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.610s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-601074108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b757dd07-0adf-4267-bf62-47a7225b8286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cb0f2567424b1ab2e06dd00950f671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:37Z,use_quota=True,user_id='f8195db49c734ea3839a313ce071b76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Creating volume b757dd07-0adf-4267-bf62-47a7225b8286 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:40 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b757dd07-0adf-4267-bf62-47a7225b8286 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c754e9-e3cb-4cbe-8064-ee3ca358391b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc526865-b1d4-4f15-aaa9-12ea18ba2dcc', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:40 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b757dd07-0adf-4267-bf62-47a7225b8286 1073741824 Sep 25 17:20:40 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a737e4c5-93be-4b45-8650-184f89a709ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:40 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Volume volume-dc526865-b1d4-4f15-aaa9-12ea18ba2dcc (dc526865-b1d4-4f15-aaa9-12ea18ba2dcc): created successfully Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a737e4c5-93be-4b45-8650-184f89a709ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Flow 'volume_create_manager' (d6168ef6-d361-4c43-8f18-0769c49047d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:40 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-efcbcf55-0c21-42d2-a9da-aaad20d1be49 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Created volume successfully. Sep 25 17:20:40 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b757dd07-0adf-4267-bf62-47a7225b8286 1073741824" returned: 0 in 0.593s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b757dd07-0adf-4267-bf62-47a7225b8286 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:40 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b757dd07-0adf-4267-bf62-47a7225b8286 Sep 25 17:20:40 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Flow 'volume_create_manager' (65fca04a-d0ef-4297-b3ca-08bc3d5366d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1ebcab-fd29-4a0f-b068-b43265483e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1ebcab-fd29-4a0f-b068-b43265483e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1616229124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b27aa9e-bd71-46f9-b605-6e9f84af9503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a4f7d46c40446449086b06b2507a3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:41Z,use_quota=True,user_id='b6d666ab32b142d581994aedb2e0f54b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77628dd-f7a2-4031-93fe-9e34912e237c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77628dd-f7a2-4031-93fe-9e34912e237c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3180beab-b8a8-428f-82ae-786e03a1bcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3180beab-b8a8-428f-82ae-786e03a1bcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b27aa9e-bd71-46f9-b605-6e9f84af9503', 'volume_name': 'volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a8fab1-39e9-47f5-b1f7-075e9fa92ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a8fab1-39e9-47f5-b1f7-075e9fa92ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f0cdfad-d871-49ef-a5e5-e7934df52f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:40 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Volume 1b27aa9e-bd71-46f9-b605-6e9f84af9503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503', 'volume_size': 1} Sep 25 17:20:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:41 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b757dd07-0adf-4267-bf62-47a7225b8286" returned: 0 in 0.287s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.153s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1616229124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b27aa9e-bd71-46f9-b605-6e9f84af9503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a4f7d46c40446449086b06b2507a3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:41Z,use_quota=True,user_id='b6d666ab32b142d581994aedb2e0f54b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Creating volume 1b27aa9e-bd71-46f9-b605-6e9f84af9503 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:41 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:20:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d3cad82-ea58-4137-88cb-e1c054f49409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b757dd07-0adf-4267-bf62-47a7225b8286', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec8b2bb-5f09-4bc8-a592-c1794589b451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:41 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 1073741824 Sep 25 17:20:41 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:41 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Volume volume-b757dd07-0adf-4267-bf62-47a7225b8286 (b757dd07-0adf-4267-bf62-47a7225b8286): created successfully Sep 25 17:20:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec8b2bb-5f09-4bc8-a592-c1794589b451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Flow 'volume_create_manager' (897b249f-7d30-4416-a17f-2b875df5f608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:41 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-91e32145-e1bd-41fc-bab2-20af13965dc8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Created volume successfully. Sep 25 17:20:41 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 1073741824" returned: 0 in 0.579s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:41 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 Sep 25 17:20:41 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:42 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503" returned: 0 in 0.312s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f0cdfad-d871-49ef-a5e5-e7934df52f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eed9c10-ad89-4240-ae03-6782efba7646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:42 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Volume volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 (1b27aa9e-bd71-46f9-b605-6e9f84af9503): created successfully Sep 25 17:20:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eed9c10-ad89-4240-ae03-6782efba7646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Flow 'volume_create_manager' (65fca04a-d0ef-4297-b3ca-08bc3d5366d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:42 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-6c035cab-4fdb-42b9-ae66-20f1d63e3dfd tempest-TestStampPattern-2048838673 None] Created volume successfully. Sep 25 17:20:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-637e22bd-32ed-452d-95b7-ee0d789c7e62 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "cinder-b757dd07-0adf-4267-bf62-47a7225b8286-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-637e22bd-32ed-452d-95b7-ee0d789c7e62 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-b757dd07-0adf-4267-bf62-47a7225b8286-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-637e22bd-32ed-452d-95b7-ee0d789c7e62 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "cinder-quobyte-b757dd07-0adf-4267-bf62-47a7225b8286" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-637e22bd-32ed-452d-95b7-ee0d789c7e62 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-quobyte-b757dd07-0adf-4267-bf62-47a7225b8286" acquired by "delete_volume" :: waited 0.032s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:42 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1efb1c-d9e8-4aac-9e68-ca4cac6cc5ef]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-637e22bd-32ed-452d-95b7-ee0d789c7e62 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b757dd07-0adf-4267-bf62-47a7225b8286 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:42 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b757dd07-0adf-4267-bf62-47a7225b8286 Sep 25 17:20:42 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:42 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-637e22bd-32ed-452d-95b7-ee0d789c7e62 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b757dd07-0adf-4267-bf62-47a7225b8286" returned: 0 in 0.449s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-637e22bd-32ed-452d-95b7-ee0d789c7e62 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b757dd07-0adf-4267-bf62-47a7225b8286 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:42 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b757dd07-0adf-4267-bf62-47a7225b8286 Sep 25 17:20:42 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:43 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-637e22bd-32ed-452d-95b7-ee0d789c7e62 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b757dd07-0adf-4267-bf62-47a7225b8286" returned: 0 in 0.326s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-637e22bd-32ed-452d-95b7-ee0d789c7e62 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-quobyte-b757dd07-0adf-4267-bf62-47a7225b8286" released by "delete_volume" :: held 0.828s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:43 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-637e22bd-32ed-452d-95b7-ee0d789c7e62 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Created reservations ['9ad02eb5-0b15-487f-bcad-e9b307f82d66', 'e16f5f84-8c80-4848-966a-68765cbdbb59', '24ce07d5-d1d0-4824-afe4-6c4b05b5cb29', 'c6581259-c8fb-42b5-99ac-fab53e2b2f35'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-637e22bd-32ed-452d-95b7-ee0d789c7e62 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-637e22bd-32ed-452d-95b7-ee0d789c7e62 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-637e22bd-32ed-452d-95b7-ee0d789c7e62 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-637e22bd-32ed-452d-95b7-ee0d789c7e62 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-637e22bd-32ed-452d-95b7-ee0d789c7e62 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-637e22bd-32ed-452d-95b7-ee0d789c7e62 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:43 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:20:43 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8117e7ca-7771-4157-b208-3e20909627a8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "cinder-dc526865-b1d4-4f15-aaa9-12ea18ba2dcc-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8117e7ca-7771-4157-b208-3e20909627a8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-dc526865-b1d4-4f15-aaa9-12ea18ba2dcc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8117e7ca-7771-4157-b208-3e20909627a8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "cinder-quobyte-dc526865-b1d4-4f15-aaa9-12ea18ba2dcc" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8117e7ca-7771-4157-b208-3e20909627a8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-quobyte-dc526865-b1d4-4f15-aaa9-12ea18ba2dcc" acquired by "delete_volume" :: waited 0.045s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:43 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[84742f66-7067-429f-be35-c9c33612130b]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8117e7ca-7771-4157-b208-3e20909627a8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-dc526865-b1d4-4f15-aaa9-12ea18ba2dcc {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:43 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-637e22bd-32ed-452d-95b7-ee0d789c7e62 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.474s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:43 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-637e22bd-32ed-452d-95b7-ee0d789c7e62 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:43 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-637e22bd-32ed-452d-95b7-ee0d789c7e62 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Deleted volume successfully. Sep 25 17:20:43 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-dc526865-b1d4-4f15-aaa9-12ea18ba2dcc Sep 25 17:20:43 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-637e22bd-32ed-452d-95b7-ee0d789c7e62 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-b757dd07-0adf-4267-bf62-47a7225b8286-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:44 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8117e7ca-7771-4157-b208-3e20909627a8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-dc526865-b1d4-4f15-aaa9-12ea18ba2dcc" returned: 0 in 0.558s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8117e7ca-7771-4157-b208-3e20909627a8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-dc526865-b1d4-4f15-aaa9-12ea18ba2dcc {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:44 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-dc526865-b1d4-4f15-aaa9-12ea18ba2dcc Sep 25 17:20:44 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:44 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8117e7ca-7771-4157-b208-3e20909627a8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-dc526865-b1d4-4f15-aaa9-12ea18ba2dcc" returned: 0 in 0.510s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:44 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8117e7ca-7771-4157-b208-3e20909627a8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-quobyte-dc526865-b1d4-4f15-aaa9-12ea18ba2dcc" released by "delete_volume" :: held 1.137s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:44 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-8117e7ca-7771-4157-b208-3e20909627a8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Created reservations ['6c08a662-6458-494a-a42c-eb6f1b7757fb', '9013d092-e214-4f50-8521-786e63fc6adf', 'ded223db-9514-4f22-8e01-ed04c5c141f2', 'ec27a43d-9645-4e9c-86ad-90283be74814'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8117e7ca-7771-4157-b208-3e20909627a8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8117e7ca-7771-4157-b208-3e20909627a8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8117e7ca-7771-4157-b208-3e20909627a8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8117e7ca-7771-4157-b208-3e20909627a8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8117e7ca-7771-4157-b208-3e20909627a8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8117e7ca-7771-4157-b208-3e20909627a8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:44 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:20:44 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:45 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8117e7ca-7771-4157-b208-3e20909627a8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.269s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:45 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-8117e7ca-7771-4157-b208-3e20909627a8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:45 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-8117e7ca-7771-4157-b208-3e20909627a8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Deleted volume successfully. Sep 25 17:20:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8117e7ca-7771-4157-b208-3e20909627a8 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-dc526865-b1d4-4f15-aaa9-12ea18ba2dcc-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3370eb0e-d9ff-4a3e-a8e6-1c5c2f557ffd tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "cinder-ffe5bb8b-87dc-4f31-900b-8290077c2b29-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3370eb0e-d9ff-4a3e-a8e6-1c5c2f557ffd tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-ffe5bb8b-87dc-4f31-900b-8290077c2b29-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3370eb0e-d9ff-4a3e-a8e6-1c5c2f557ffd tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "cinder-quobyte-ffe5bb8b-87dc-4f31-900b-8290077c2b29" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3370eb0e-d9ff-4a3e-a8e6-1c5c2f557ffd tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-quobyte-ffe5bb8b-87dc-4f31-900b-8290077c2b29" acquired by "delete_volume" :: waited 0.016s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:45 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[934f07c6-eb3a-40ad-bfd1-a7c4e04ac805]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3370eb0e-d9ff-4a3e-a8e6-1c5c2f557ffd tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ffe5bb8b-87dc-4f31-900b-8290077c2b29 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:46 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ffe5bb8b-87dc-4f31-900b-8290077c2b29 Sep 25 17:20:46 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:46 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3370eb0e-d9ff-4a3e-a8e6-1c5c2f557ffd tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ffe5bb8b-87dc-4f31-900b-8290077c2b29" returned: 0 in 0.428s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3370eb0e-d9ff-4a3e-a8e6-1c5c2f557ffd tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ffe5bb8b-87dc-4f31-900b-8290077c2b29 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:46 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ffe5bb8b-87dc-4f31-900b-8290077c2b29 Sep 25 17:20:46 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:46 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3370eb0e-d9ff-4a3e-a8e6-1c5c2f557ffd tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ffe5bb8b-87dc-4f31-900b-8290077c2b29" returned: 0 in 0.290s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:46 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3370eb0e-d9ff-4a3e-a8e6-1c5c2f557ffd tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-quobyte-ffe5bb8b-87dc-4f31-900b-8290077c2b29" released by "delete_volume" :: held 0.785s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:46 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-3370eb0e-d9ff-4a3e-a8e6-1c5c2f557ffd tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Created reservations ['cfcf66fb-0f16-4cd2-a3d4-64e530f58a84', 'f4f38992-209e-4ebb-85ed-1535bf19bed5', '703c7b8b-4f8b-4f83-87a2-dd6517ec2006', '8d70ffa6-cd76-441a-ba99-0645273b315b'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3370eb0e-d9ff-4a3e-a8e6-1c5c2f557ffd tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3370eb0e-d9ff-4a3e-a8e6-1c5c2f557ffd tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:46 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3370eb0e-d9ff-4a3e-a8e6-1c5c2f557ffd tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:46 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3370eb0e-d9ff-4a3e-a8e6-1c5c2f557ffd tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3370eb0e-d9ff-4a3e-a8e6-1c5c2f557ffd tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3370eb0e-d9ff-4a3e-a8e6-1c5c2f557ffd tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:46 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:20:46 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a88ee2c3-fddd-4fd4-ba2e-e1add82606a0 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "cinder-6239ac13-f41c-46bc-84d1-419f0d9ca666-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a88ee2c3-fddd-4fd4-ba2e-e1add82606a0 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-6239ac13-f41c-46bc-84d1-419f0d9ca666-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a88ee2c3-fddd-4fd4-ba2e-e1add82606a0 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "cinder-quobyte-6239ac13-f41c-46bc-84d1-419f0d9ca666" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a88ee2c3-fddd-4fd4-ba2e-e1add82606a0 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-quobyte-6239ac13-f41c-46bc-84d1-419f0d9ca666" acquired by "delete_volume" :: waited 0.031s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:47 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3370eb0e-d9ff-4a3e-a8e6-1c5c2f557ffd tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.388s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:47 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-3370eb0e-d9ff-4a3e-a8e6-1c5c2f557ffd tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:47 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-3370eb0e-d9ff-4a3e-a8e6-1c5c2f557ffd tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Deleted volume successfully. Sep 25 17:20:47 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5dc7d9-b300-4947-bd76-294000665825]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a88ee2c3-fddd-4fd4-ba2e-e1add82606a0 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6239ac13-f41c-46bc-84d1-419f0d9ca666 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3370eb0e-d9ff-4a3e-a8e6-1c5c2f557ffd tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-ffe5bb8b-87dc-4f31-900b-8290077c2b29-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:47 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6239ac13-f41c-46bc-84d1-419f0d9ca666 Sep 25 17:20:47 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:47 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a88ee2c3-fddd-4fd4-ba2e-e1add82606a0 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6239ac13-f41c-46bc-84d1-419f0d9ca666" returned: 0 in 0.454s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a88ee2c3-fddd-4fd4-ba2e-e1add82606a0 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6239ac13-f41c-46bc-84d1-419f0d9ca666 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:47 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6239ac13-f41c-46bc-84d1-419f0d9ca666 Sep 25 17:20:47 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:48 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a88ee2c3-fddd-4fd4-ba2e-e1add82606a0 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6239ac13-f41c-46bc-84d1-419f0d9ca666" returned: 0 in 0.456s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a88ee2c3-fddd-4fd4-ba2e-e1add82606a0 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-quobyte-6239ac13-f41c-46bc-84d1-419f0d9ca666" released by "delete_volume" :: held 1.008s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Flow 'volume_create_manager' (5f597cd7-18c0-4c45-a3fe-33d2c1b62bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a3e5bd-d93d-4dd2-af6d-cfde7ec5fac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a3e5bd-d93d-4dd2-af6d-cfde7ec5fac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1823331378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5cb1dc-5a4b-476d-b5af-f708367cc417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410f0b86633e40f4aeed9c259ff18e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:48Z,use_quota=True,user_id='07bff9f30e6d441e9da63a6be5f2edce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb0899d-11a8-4234-ad3b-15804c04ba83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb0899d-11a8-4234-ad3b-15804c04ba83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac0f20e-57ee-43e3-8c92-39c89679976a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac0f20e-57ee-43e3-8c92-39c89679976a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c5cb1dc-5a4b-476d-b5af-f708367cc417', 'volume_name': 'volume-1c5cb1dc-5a4b-476d-b5af-f708367cc417', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f9c80e-5c36-4703-901c-a10b6b02f904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f9c80e-5c36-4703-901c-a10b6b02f904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1af1683-9895-4c88-9061-4963c6164294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:48 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Volume 1c5cb1dc-5a4b-476d-b5af-f708367cc417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c5cb1dc-5a4b-476d-b5af-f708367cc417', 'volume_size': 1} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1823331378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5cb1dc-5a4b-476d-b5af-f708367cc417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410f0b86633e40f4aeed9c259ff18e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:48Z,use_quota=True,user_id='07bff9f30e6d441e9da63a6be5f2edce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Creating volume 1c5cb1dc-5a4b-476d-b5af-f708367cc417 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:48 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1c5cb1dc-5a4b-476d-b5af-f708367cc417 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-a88ee2c3-fddd-4fd4-ba2e-e1add82606a0 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Created reservations ['1bfb5d87-cf1d-4a6c-ac13-a49d4511cbac', '61ffaf3c-fa5b-4b17-bfbc-f28f9c227bbd', '9f45b466-777b-4691-9b9c-7854ab6b7581', '0b04e3a9-67f7-4b2d-a970-7f6b56876a51'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:48 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1c5cb1dc-5a4b-476d-b5af-f708367cc417 1073741824 Sep 25 17:20:48 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a88ee2c3-fddd-4fd4-ba2e-e1add82606a0 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a88ee2c3-fddd-4fd4-ba2e-e1add82606a0 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a88ee2c3-fddd-4fd4-ba2e-e1add82606a0 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a88ee2c3-fddd-4fd4-ba2e-e1add82606a0 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a88ee2c3-fddd-4fd4-ba2e-e1add82606a0 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a88ee2c3-fddd-4fd4-ba2e-e1add82606a0 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:48 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:20:48 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:49 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a88ee2c3-fddd-4fd4-ba2e-e1add82606a0 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.481s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:49 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-a88ee2c3-fddd-4fd4-ba2e-e1add82606a0 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:49 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-a88ee2c3-fddd-4fd4-ba2e-e1add82606a0 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Deleted volume successfully. Sep 25 17:20:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a88ee2c3-fddd-4fd4-ba2e-e1add82606a0 tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-6239ac13-f41c-46bc-84d1-419f0d9ca666-delete_volume" released by "delete_volume" :: held 2.225s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-32dff030-6720-41fb-92e5-f3eb4a08d53b tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "cinder-97b74654-5819-4926-8c52-46939a8dfb49-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-32dff030-6720-41fb-92e5-f3eb4a08d53b tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-97b74654-5819-4926-8c52-46939a8dfb49-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:49 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1c5cb1dc-5a4b-476d-b5af-f708367cc417 1073741824" returned: 0 in 0.909s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-32dff030-6720-41fb-92e5-f3eb4a08d53b tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "cinder-quobyte-97b74654-5819-4926-8c52-46939a8dfb49" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-32dff030-6720-41fb-92e5-f3eb4a08d53b tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-quobyte-97b74654-5819-4926-8c52-46939a8dfb49" acquired by "delete_volume" :: waited 0.024s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1c5cb1dc-5a4b-476d-b5af-f708367cc417 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:49 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[143354d6-f221-4f30-9de1-4619e3c6fb5e]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-32dff030-6720-41fb-92e5-f3eb4a08d53b tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97b74654-5819-4926-8c52-46939a8dfb49 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:49 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1c5cb1dc-5a4b-476d-b5af-f708367cc417 Sep 25 17:20:49 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:49 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97b74654-5819-4926-8c52-46939a8dfb49 Sep 25 17:20:49 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:49 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1c5cb1dc-5a4b-476d-b5af-f708367cc417" returned: 0 in 0.255s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1af1683-9895-4c88-9061-4963c6164294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c5cb1dc-5a4b-476d-b5af-f708367cc417', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f22d15-a543-4ce0-b346-6b385c4b6612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:49 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Volume volume-1c5cb1dc-5a4b-476d-b5af-f708367cc417 (1c5cb1dc-5a4b-476d-b5af-f708367cc417): created successfully Sep 25 17:20:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f22d15-a543-4ce0-b346-6b385c4b6612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Flow 'volume_create_manager' (5f597cd7-18c0-4c45-a3fe-33d2c1b62bf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:49 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-9084cbc6-bdb1-4b80-b354-dc69a391a7b6 tempest-VolumesServicesTestJSON-1526751831 None] Created volume successfully. Sep 25 17:20:49 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-32dff030-6720-41fb-92e5-f3eb4a08d53b tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97b74654-5819-4926-8c52-46939a8dfb49" returned: 0 in 0.395s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-32dff030-6720-41fb-92e5-f3eb4a08d53b tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97b74654-5819-4926-8c52-46939a8dfb49 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:49 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97b74654-5819-4926-8c52-46939a8dfb49 Sep 25 17:20:49 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:50 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-32dff030-6720-41fb-92e5-f3eb4a08d53b tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97b74654-5819-4926-8c52-46939a8dfb49" returned: 0 in 0.268s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-32dff030-6720-41fb-92e5-f3eb4a08d53b tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-quobyte-97b74654-5819-4926-8c52-46939a8dfb49" released by "delete_volume" :: held 0.726s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-32dff030-6720-41fb-92e5-f3eb4a08d53b tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Created reservations ['d9db46a2-ccd3-478f-9450-994fe4e4bb36', 'e20df9a2-2575-48fa-9774-4b3a2ec76d99', '8b3c3849-2fc8-4cf9-8185-d46400982706', '875bd0f8-73c9-44a1-a38e-17f17feac5fa'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6958f754-f518-4b44-adf1-45019be3db10 tempest-VolumesServicesTestJSON-1526751831 None] Acquiring lock "cinder-1c5cb1dc-5a4b-476d-b5af-f708367cc417-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6958f754-f518-4b44-adf1-45019be3db10 tempest-VolumesServicesTestJSON-1526751831 None] Lock "cinder-1c5cb1dc-5a4b-476d-b5af-f708367cc417-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-32dff030-6720-41fb-92e5-f3eb4a08d53b tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-32dff030-6720-41fb-92e5-f3eb4a08d53b tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-32dff030-6720-41fb-92e5-f3eb4a08d53b tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-32dff030-6720-41fb-92e5-f3eb4a08d53b tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-32dff030-6720-41fb-92e5-f3eb4a08d53b tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-32dff030-6720-41fb-92e5-f3eb4a08d53b tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6958f754-f518-4b44-adf1-45019be3db10 tempest-VolumesServicesTestJSON-1526751831 None] Acquiring lock "cinder-quobyte-1c5cb1dc-5a4b-476d-b5af-f708367cc417" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:50 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:20:50 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6958f754-f518-4b44-adf1-45019be3db10 tempest-VolumesServicesTestJSON-1526751831 None] Lock "cinder-quobyte-1c5cb1dc-5a4b-476d-b5af-f708367cc417" acquired by "delete_volume" :: waited 0.024s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[889feda1-99c8-4a1e-afc5-e5022cc35eec]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6958f754-f518-4b44-adf1-45019be3db10 tempest-VolumesServicesTestJSON-1526751831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1c5cb1dc-5a4b-476d-b5af-f708367cc417 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-abef329e-5dac-441c-be4d-cfc0fbd0e50d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "cinder-0dcd0548-6ea2-4246-964f-6a74ac622416-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-abef329e-5dac-441c-be4d-cfc0fbd0e50d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-0dcd0548-6ea2-4246-964f-6a74ac622416-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:50 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1c5cb1dc-5a4b-476d-b5af-f708367cc417 Sep 25 17:20:50 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-abef329e-5dac-441c-be4d-cfc0fbd0e50d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "cinder-quobyte-0dcd0548-6ea2-4246-964f-6a74ac622416" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-abef329e-5dac-441c-be4d-cfc0fbd0e50d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-quobyte-0dcd0548-6ea2-4246-964f-6a74ac622416" acquired by "delete_volume" :: waited 0.029s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:50 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-32dff030-6720-41fb-92e5-f3eb4a08d53b tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.487s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-32dff030-6720-41fb-92e5-f3eb4a08d53b tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:50 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-32dff030-6720-41fb-92e5-f3eb4a08d53b tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Deleted volume successfully. Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba8724b-3722-4699-a3f3-01856f2cc0af]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-abef329e-5dac-441c-be4d-cfc0fbd0e50d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dcd0548-6ea2-4246-964f-6a74ac622416 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-32dff030-6720-41fb-92e5-f3eb4a08d53b tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-97b74654-5819-4926-8c52-46939a8dfb49-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:51 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dcd0548-6ea2-4246-964f-6a74ac622416 Sep 25 17:20:51 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:51 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6958f754-f518-4b44-adf1-45019be3db10 tempest-VolumesServicesTestJSON-1526751831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1c5cb1dc-5a4b-476d-b5af-f708367cc417" returned: 0 in 0.684s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6958f754-f518-4b44-adf1-45019be3db10 tempest-VolumesServicesTestJSON-1526751831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1c5cb1dc-5a4b-476d-b5af-f708367cc417 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:51 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1c5cb1dc-5a4b-476d-b5af-f708367cc417 Sep 25 17:20:51 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:51 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-abef329e-5dac-441c-be4d-cfc0fbd0e50d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dcd0548-6ea2-4246-964f-6a74ac622416" returned: 0 in 0.455s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-abef329e-5dac-441c-be4d-cfc0fbd0e50d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dcd0548-6ea2-4246-964f-6a74ac622416 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:51 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dcd0548-6ea2-4246-964f-6a74ac622416 Sep 25 17:20:51 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:51 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6958f754-f518-4b44-adf1-45019be3db10 tempest-VolumesServicesTestJSON-1526751831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1c5cb1dc-5a4b-476d-b5af-f708367cc417" returned: 0 in 0.325s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6958f754-f518-4b44-adf1-45019be3db10 tempest-VolumesServicesTestJSON-1526751831 None] Lock "cinder-quobyte-1c5cb1dc-5a4b-476d-b5af-f708367cc417" released by "delete_volume" :: held 1.104s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:51 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-6958f754-f518-4b44-adf1-45019be3db10 tempest-VolumesServicesTestJSON-1526751831 None] Created reservations ['bf10244e-db62-46ca-85f8-921a87a3dd5f', '38fe34e9-f44a-4d26-8b66-b4af2ea70a7c', '4df5c427-5c72-471a-bd29-29cb42084331', '6b027f23-c4be-4eb5-a42a-b681276bc286'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6958f754-f518-4b44-adf1-45019be3db10 tempest-VolumesServicesTestJSON-1526751831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6958f754-f518-4b44-adf1-45019be3db10 tempest-VolumesServicesTestJSON-1526751831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6958f754-f518-4b44-adf1-45019be3db10 tempest-VolumesServicesTestJSON-1526751831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6958f754-f518-4b44-adf1-45019be3db10 tempest-VolumesServicesTestJSON-1526751831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6958f754-f518-4b44-adf1-45019be3db10 tempest-VolumesServicesTestJSON-1526751831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6958f754-f518-4b44-adf1-45019be3db10 tempest-VolumesServicesTestJSON-1526751831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:51 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:20:51 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:51 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-abef329e-5dac-441c-be4d-cfc0fbd0e50d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0dcd0548-6ea2-4246-964f-6a74ac622416" returned: 0 in 0.463s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-abef329e-5dac-441c-be4d-cfc0fbd0e50d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-quobyte-0dcd0548-6ea2-4246-964f-6a74ac622416" released by "delete_volume" :: held 1.017s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:52 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-abef329e-5dac-441c-be4d-cfc0fbd0e50d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Created reservations ['461e246a-adea-4303-b4ef-a75b9d33b21c', '7de0dec7-524e-4d7f-8f9c-e9b189e6d53e', 'be918bd8-3ca3-4801-a279-842345385448', '5ea4019b-6274-4e99-8624-be5d280f8915'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-abef329e-5dac-441c-be4d-cfc0fbd0e50d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-abef329e-5dac-441c-be4d-cfc0fbd0e50d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:52 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-abef329e-5dac-441c-be4d-cfc0fbd0e50d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:52 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-abef329e-5dac-441c-be4d-cfc0fbd0e50d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-abef329e-5dac-441c-be4d-cfc0fbd0e50d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-abef329e-5dac-441c-be4d-cfc0fbd0e50d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:52 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:20:52 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:52 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6958f754-f518-4b44-adf1-45019be3db10 tempest-VolumesServicesTestJSON-1526751831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.398s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:52 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-6958f754-f518-4b44-adf1-45019be3db10 tempest-VolumesServicesTestJSON-1526751831 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:52 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-6958f754-f518-4b44-adf1-45019be3db10 tempest-VolumesServicesTestJSON-1526751831 None] Deleted volume successfully. Sep 25 17:20:52 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6958f754-f518-4b44-adf1-45019be3db10 tempest-VolumesServicesTestJSON-1526751831 None] Lock "cinder-1c5cb1dc-5a4b-476d-b5af-f708367cc417-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:52 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-abef329e-5dac-441c-be4d-cfc0fbd0e50d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.319s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:52 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-abef329e-5dac-441c-be4d-cfc0fbd0e50d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:52 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-abef329e-5dac-441c-be4d-cfc0fbd0e50d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Deleted volume successfully. Sep 25 17:20:52 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-abef329e-5dac-441c-be4d-cfc0fbd0e50d tempest-CreateVolumesFromSourceVolumeTest-1762541967 None] Lock "cinder-0dcd0548-6ea2-4246-964f-6a74ac622416-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:20:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:53 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:20:53 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:54 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.320s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:54 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:54 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:20:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 28 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:20:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Flow 'volume_create_manager' (aff182ca-8229-4dc0-9253-eee972f6bd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f89795-80a1-456f-b303-c745b8ffdb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f89795-80a1-456f-b303-c745b8ffdb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-104350475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0597fa93-ca0f-4050-9239-39feaf4f908d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad7889355e046eaaad450835e833fad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:01Z,use_quota=True,user_id='c9a72fb475a7455b953cfd1205e8ac24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21afb5d7-92d3-4d97-af47-a89690283bb6),volume_type_id=21afb5d7-92d3-4d97-af47-a89690283bb6)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa851aeb-1768-4533-9d24-1ce2c5120827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa851aeb-1768-4533-9d24-1ce2c5120827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32ae3da-4459-4ca3-b5a2-5d9f13430aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32ae3da-4459-4ca3-b5a2-5d9f13430aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0597fa93-ca0f-4050-9239-39feaf4f908d', 'volume_name': 'volume-0597fa93-ca0f-4050-9239-39feaf4f908d', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d439f56f-5070-4025-9e8b-ab8c67727673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d439f56f-5070-4025-9e8b-ab8c67727673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c67b6bb-cbc1-4f18-b1d9-1b23b7772e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:01 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Volume 0597fa93-ca0f-4050-9239-39feaf4f908d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0597fa93-ca0f-4050-9239-39feaf4f908d', 'volume_size': 1} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-104350475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0597fa93-ca0f-4050-9239-39feaf4f908d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad7889355e046eaaad450835e833fad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:01Z,use_quota=True,user_id='c9a72fb475a7455b953cfd1205e8ac24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21afb5d7-92d3-4d97-af47-a89690283bb6),volume_type_id=21afb5d7-92d3-4d97-af47-a89690283bb6)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Creating volume 0597fa93-ca0f-4050-9239-39feaf4f908d {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:21:01 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0597fa93-ca0f-4050-9239-39feaf4f908d 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:01 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0597fa93-ca0f-4050-9239-39feaf4f908d 1073741824 Sep 25 17:21:01 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Flow 'volume_create_manager' (bae20859-7278-4956-be60-a19e8bb4b709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3147441e-1156-4433-aed3-0bc8f03daede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3147441e-1156-4433-aed3-0bc8f03daede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42012ab2-a101-4cdb-926b-29cf3c976b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1405a31d91c343009da1fc1793da35d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:01Z,use_quota=True,user_id='63623cdb52504fb5b5201181e8740712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf77660c-445b-4023-a92f-52cb313cccce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf77660c-445b-4023-a92f-52cb313cccce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d984ad-2ed1-4feb-8a6d-c3c4f2da9dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.image.glance [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Creating Keystone auth plugin from conf {{(pid=87211) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 17:21:01 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0597fa93-ca0f-4050-9239-39feaf4f908d 1073741824" returned: 0 in 0.533s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d984ad-2ed1-4feb-8a6d-c3c4f2da9dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '42012ab2-a101-4cdb-926b-29cf3c976b57', 'volume_name': 'volume-42012ab2-a101-4cdb-926b-29cf3c976b57', 'volume_size': 1, 'image_id': '19390886-3b4e-4187-8d9f-e00ebed2eee9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19390886-3b4e-4187-8d9f-e00ebed2eee9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0250c39707610f2120752db5f05e8ddc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1405a31d91c343009da1fc1793da35d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '631dbeabccc781ce835f120376d4f7a95de9d64ebf531259cccd2a8a752e9925bf394a19360e4a7312f944ead3e56a22c2a7c15889777e837f84fd4da6244c7d', 'id': '19390886-3b4e-4187-8d9f-e00ebed2eee9', 'created_at': datetime.datetime(2026, 9, 25, 15, 20, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19390886-3b4e-4187-8d9f-e00ebed2eee9/file', 'properties': {}}, 'image_service': }' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed4de3d-56b2-46d4-ad1d-420c55d073d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed4de3d-56b2-46d4-ad1d-420c55d073d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7be459-7898-4b62-96e7-4fcf7ecc42a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:01 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Volume 42012ab2-a101-4cdb-926b-29cf3c976b57: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-42012ab2-a101-4cdb-926b-29cf3c976b57', 'volume_size': 1, 'image_id': '19390886-3b4e-4187-8d9f-e00ebed2eee9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19390886-3b4e-4187-8d9f-e00ebed2eee9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0250c39707610f2120752db5f05e8ddc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1405a31d91c343009da1fc1793da35d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '631dbeabccc781ce835f120376d4f7a95de9d64ebf531259cccd2a8a752e9925bf394a19360e4a7312f944ead3e56a22c2a7c15889777e837f84fd4da6244c7d', 'id': '19390886-3b4e-4187-8d9f-e00ebed2eee9', 'created_at': datetime.datetime(2026, 9, 25, 15, 20, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19390886-3b4e-4187-8d9f-e00ebed2eee9/file', 'properties': {}}, 'image_service': } Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Trying to clone 42012ab2-a101-4cdb-926b-29cf3c976b57 from image 19390886-3b4e-4187-8d9f-e00ebed2eee9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/19390886-3b4e-4187-8d9f-e00ebed2eee9', 'metadata': {}}]). {{(pid=87211) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 17:21:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0597fa93-ca0f-4050-9239-39feaf4f908d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:02 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0597fa93-ca0f-4050-9239-39feaf4f908d Sep 25 17:21:02 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:02 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 17:21:02 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Image download 0.00 MB at 0.00 MB/s Sep 25 17:21:02 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8d7182-cf4a-4b9f-8844-83248073b4c1]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:02 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD Sep 25 17:21:02 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:02 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0597fa93-ca0f-4050-9239-39feaf4f908d" returned: 0 in 0.313s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:21:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c67b6bb-cbc1-4f18-b1d9-1b23b7772e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0597fa93-ca0f-4050-9239-39feaf4f908d', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab754543-8755-4f61-881d-c628beedbfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:02 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Volume volume-0597fa93-ca0f-4050-9239-39feaf4f908d (0597fa93-ca0f-4050-9239-39feaf4f908d): created successfully Sep 25 17:21:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab754543-8755-4f61-881d-c628beedbfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Flow 'volume_create_manager' (aff182ca-8229-4dc0-9253-eee972f6bd7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:21:02 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-4cc8b8e1-b33e-4205-b634-592ec8370720 tempest-VolumeTypesAccessTest-1755082570 None] Created volume successfully. Sep 25 17:21:02 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:02 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD Sep 25 17:21:02 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:02 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD" returned: 1 in 0.395s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:21:02 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Temporary image 19390886-3b4e-4187-8d9f-e00ebed2eee9 is fetched for user 63623cdb52504fb5b5201181e8740712. {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e00959-278c-4548-ab21-cff489840513]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:03 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD Sep 25 17:21:03 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8a820450-4e43-41de-9a59-8829800da8ff tempest-VolumeTypesAccessTest-1755082570 None] Acquiring lock "cinder-0597fa93-ca0f-4050-9239-39feaf4f908d-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8a820450-4e43-41de-9a59-8829800da8ff tempest-VolumeTypesAccessTest-1755082570 None] Lock "cinder-0597fa93-ca0f-4050-9239-39feaf4f908d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8a820450-4e43-41de-9a59-8829800da8ff tempest-VolumeTypesAccessTest-1755082570 None] Acquiring lock "cinder-quobyte-0597fa93-ca0f-4050-9239-39feaf4f908d" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8a820450-4e43-41de-9a59-8829800da8ff tempest-VolumeTypesAccessTest-1755082570 None] Lock "cinder-quobyte-0597fa93-ca0f-4050-9239-39feaf4f908d" acquired by "delete_volume" :: waited 0.022s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bc1e84-4bed-4139-8993-e10cda4b146e]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8a820450-4e43-41de-9a59-8829800da8ff tempest-VolumeTypesAccessTest-1755082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0597fa93-ca0f-4050-9239-39feaf4f908d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:03 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD" returned: 0 in 0.445s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:03 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0597fa93-ca0f-4050-9239-39feaf4f908d Sep 25 17:21:03 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:03 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD Sep 25 17:21:03 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:03 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD" returned: 1 in 0.347s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:03 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42012ab2-a101-4cdb-926b-29cf3c976b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1405a31d91c343009da1fc1793da35d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:01Z,use_quota=True,user_id='63623cdb52504fb5b5201181e8740712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Creating volume 42012ab2-a101-4cdb-926b-29cf3c976b57 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:21:03 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42012ab2-a101-4cdb-926b-29cf3c976b57 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8a820450-4e43-41de-9a59-8829800da8ff tempest-VolumeTypesAccessTest-1755082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0597fa93-ca0f-4050-9239-39feaf4f908d" returned: 0 in 0.428s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8a820450-4e43-41de-9a59-8829800da8ff tempest-VolumeTypesAccessTest-1755082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0597fa93-ca0f-4050-9239-39feaf4f908d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:03 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42012ab2-a101-4cdb-926b-29cf3c976b57 1073741824 Sep 25 17:21:03 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:03 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0597fa93-ca0f-4050-9239-39feaf4f908d Sep 25 17:21:03 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:04 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8a820450-4e43-41de-9a59-8829800da8ff tempest-VolumeTypesAccessTest-1755082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0597fa93-ca0f-4050-9239-39feaf4f908d" returned: 0 in 0.289s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8a820450-4e43-41de-9a59-8829800da8ff tempest-VolumeTypesAccessTest-1755082570 None] Lock "cinder-quobyte-0597fa93-ca0f-4050-9239-39feaf4f908d" released by "delete_volume" :: held 0.777s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:04 devstack cinder-volume[87211]: WARNING cinder.quota [None req-8a820450-4e43-41de-9a59-8829800da8ff tempest-VolumeTypesAccessTest-1755082570 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1396850312 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1396850312, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:21:04 devstack cinder-volume[87211]: WARNING cinder.quota [None req-8a820450-4e43-41de-9a59-8829800da8ff tempest-VolumeTypesAccessTest-1755082570 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1396850312 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1396850312, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:21:04 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-8a820450-4e43-41de-9a59-8829800da8ff tempest-VolumeTypesAccessTest-1755082570 None] Created reservations ['e2ed4c52-db5f-4549-83cd-b312ac0fd300', '2d3142c6-d940-4d47-8a2b-02cd5c849b55', '5bcc8e6a-d863-4532-ba96-d5d8db4a382d', '71ff48b4-c9c4-4744-8a52-a22046a3ed9c'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:21:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8a820450-4e43-41de-9a59-8829800da8ff tempest-VolumeTypesAccessTest-1755082570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8a820450-4e43-41de-9a59-8829800da8ff tempest-VolumeTypesAccessTest-1755082570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:04 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8a820450-4e43-41de-9a59-8829800da8ff tempest-VolumeTypesAccessTest-1755082570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:21:04 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8a820450-4e43-41de-9a59-8829800da8ff tempest-VolumeTypesAccessTest-1755082570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:21:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8a820450-4e43-41de-9a59-8829800da8ff tempest-VolumeTypesAccessTest-1755082570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8a820450-4e43-41de-9a59-8829800da8ff tempest-VolumeTypesAccessTest-1755082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:04 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42012ab2-a101-4cdb-926b-29cf3c976b57 1073741824" returned: 0 in 0.483s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:04 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:21:04 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42012ab2-a101-4cdb-926b-29cf3c976b57 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:04 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42012ab2-a101-4cdb-926b-29cf3c976b57 Sep 25 17:21:04 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:04 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8a820450-4e43-41de-9a59-8829800da8ff tempest-VolumeTypesAccessTest-1755082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.301s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:04 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-8a820450-4e43-41de-9a59-8829800da8ff tempest-VolumeTypesAccessTest-1755082570 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:21:04 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42012ab2-a101-4cdb-926b-29cf3c976b57" returned: 0 in 0.261s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:04 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:21:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:04 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-8a820450-4e43-41de-9a59-8829800da8ff tempest-VolumeTypesAccessTest-1755082570 None] Deleted volume successfully. Sep 25 17:21:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8a820450-4e43-41de-9a59-8829800da8ff tempest-VolumeTypesAccessTest-1755082570 None] Lock "cinder-0597fa93-ca0f-4050-9239-39feaf4f908d-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:04 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Attempting download of 19390886-3b4e-4187-8d9f-e00ebed2eee9 ((None, [{'url': 'file:///opt/stack/data/glance/images/19390886-3b4e-4187-8d9f-e00ebed2eee9', 'metadata': {}}])) to volume 42012ab2-a101-4cdb-926b-29cf3c976b57. {{(pid=87211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 17:21:04 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[165a020e-e057-4d07-8946-73052e96497f]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19390886-3b4e-4187-8d9f-e00ebed2eee9_6qcxgl3a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:04 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19390886-3b4e-4187-8d9f-e00ebed2eee9_6qcxgl3a Sep 25 17:21:04 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:05 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19390886-3b4e-4187-8d9f-e00ebed2eee9_6qcxgl3a" returned: 0 in 0.343s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19390886-3b4e-4187-8d9f-e00ebed2eee9_6qcxgl3a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:05 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19390886-3b4e-4187-8d9f-e00ebed2eee9_6qcxgl3a Sep 25 17:21:05 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:05 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19390886-3b4e-4187-8d9f-e00ebed2eee9_6qcxgl3a" returned: 1 in 0.334s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19390886-3b4e-4187-8d9f-e00ebed2eee9_6qcxgl3a' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:21:05 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffa6794-dee6-4b69-9cf7-19a0e2d94072]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:05 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD Sep 25 17:21:05 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:05 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:05 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD Sep 25 17:21:05 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:06 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD" returned: 1 in 0.355s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:21:06 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] 19390886-3b4e-4187-8d9f-e00ebed2eee9 was raw, converting to qcow2 {{(pid=87211) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 17:21:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42012ab2-a101-4cdb-926b-29cf3c976b57 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:06 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42012ab2-a101-4cdb-926b-29cf3c976b57 Sep 25 17:21:06 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:06 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=125,cinder:UPDATE=177,cinder:DELETE=16,cinder:INSERT=46 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:21:06 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=127,cinder:INSERT=37,cinder:UPDATE=187,cinder:DELETE=16 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:21:06 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42012ab2-a101-4cdb-926b-29cf3c976b57" returned: 0 in 0.608s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:06 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_19390886-3b4e-4187-8d9f-e00ebed2eee9_7_o3vfw2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42012ab2-a101-4cdb-926b-29cf3c976b57 {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:21:06 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 17:21:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42012ab2-a101-4cdb-926b-29cf3c976b57 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:06 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42012ab2-a101-4cdb-926b-29cf3c976b57 1G Sep 25 17:21:06 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:07 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42012ab2-a101-4cdb-926b-29cf3c976b57 1G" returned: 0 in 0.362s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:07 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Downloaded image 19390886-3b4e-4187-8d9f-e00ebed2eee9 ((None, [{'url': 'file:///opt/stack/data/glance/images/19390886-3b4e-4187-8d9f-e00ebed2eee9', 'metadata': {}}])) to volume 42012ab2-a101-4cdb-926b-29cf3c976b57 successfully. {{(pid=87211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 17:21:07 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Temporary image 19390886-3b4e-4187-8d9f-e00ebed2eee9 for user 63623cdb52504fb5b5201181e8740712 is deleted. {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 17:21:07 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Marking volume 42012ab2-a101-4cdb-926b-29cf3c976b57 as bootable. {{(pid=87211) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 17:21:07 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Copying metadata from image 19390886-3b4e-4187-8d9f-e00ebed2eee9 to 42012ab2-a101-4cdb-926b-29cf3c976b57. {{(pid=87211) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 17:21:07 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Creating volume glance metadata for volume 42012ab2-a101-4cdb-926b-29cf3c976b57 backed by image 19390886-3b4e-4187-8d9f-e00ebed2eee9 with: {'image_id': '19390886-3b4e-4187-8d9f-e00ebed2eee9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0250c39707610f2120752db5f05e8ddc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87211) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 17:21:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7be459-7898-4b62-96e7-4fcf7ecc42a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42012ab2-a101-4cdb-926b-29cf3c976b57', 'volume_size': 1, 'image_id': '19390886-3b4e-4187-8d9f-e00ebed2eee9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19390886-3b4e-4187-8d9f-e00ebed2eee9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0250c39707610f2120752db5f05e8ddc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1405a31d91c343009da1fc1793da35d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '631dbeabccc781ce835f120376d4f7a95de9d64ebf531259cccd2a8a752e9925bf394a19360e4a7312f944ead3e56a22c2a7c15889777e837f84fd4da6244c7d', 'id': '19390886-3b4e-4187-8d9f-e00ebed2eee9', 'created_at': datetime.datetime(2026, 9, 25, 15, 20, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19390886-3b4e-4187-8d9f-e00ebed2eee9/file', 'properties': {}}, 'image_service': }' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420638b3-d19c-4721-91f3-85416343de9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:07 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Volume volume-42012ab2-a101-4cdb-926b-29cf3c976b57 (42012ab2-a101-4cdb-926b-29cf3c976b57): created successfully Sep 25 17:21:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420638b3-d19c-4721-91f3-85416343de9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Flow 'volume_create_manager' (bae20859-7278-4956-be60-a19e8bb4b709) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:21:07 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-f3d9edca-4bfb-4199-b265-04d14baa5490 tempest-VolumeImageDependencyTests-1941571554 None] Created volume successfully. Sep 25 17:21:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-94fb7017-e571-4e83-a4fa-c4f317860038 tempest-VolumeImageDependencyTests-1941571554 None] Acquiring lock "cinder-42012ab2-a101-4cdb-926b-29cf3c976b57-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-94fb7017-e571-4e83-a4fa-c4f317860038 tempest-VolumeImageDependencyTests-1941571554 None] Lock "cinder-42012ab2-a101-4cdb-926b-29cf3c976b57-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-94fb7017-e571-4e83-a4fa-c4f317860038 tempest-VolumeImageDependencyTests-1941571554 None] Acquiring lock "cinder-quobyte-42012ab2-a101-4cdb-926b-29cf3c976b57" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-94fb7017-e571-4e83-a4fa-c4f317860038 tempest-VolumeImageDependencyTests-1941571554 None] Lock "cinder-quobyte-42012ab2-a101-4cdb-926b-29cf3c976b57" acquired by "delete_volume" :: waited 0.021s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:07 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[66751a0f-4604-4ad4-86f2-ef6f14327642]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-94fb7017-e571-4e83-a4fa-c4f317860038 tempest-VolumeImageDependencyTests-1941571554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42012ab2-a101-4cdb-926b-29cf3c976b57 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:07 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42012ab2-a101-4cdb-926b-29cf3c976b57 Sep 25 17:21:07 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:08 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-94fb7017-e571-4e83-a4fa-c4f317860038 tempest-VolumeImageDependencyTests-1941571554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42012ab2-a101-4cdb-926b-29cf3c976b57" returned: 0 in 0.435s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-94fb7017-e571-4e83-a4fa-c4f317860038 tempest-VolumeImageDependencyTests-1941571554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42012ab2-a101-4cdb-926b-29cf3c976b57 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:08 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42012ab2-a101-4cdb-926b-29cf3c976b57 Sep 25 17:21:08 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:08 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-94fb7017-e571-4e83-a4fa-c4f317860038 tempest-VolumeImageDependencyTests-1941571554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-42012ab2-a101-4cdb-926b-29cf3c976b57" returned: 0 in 0.319s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-94fb7017-e571-4e83-a4fa-c4f317860038 tempest-VolumeImageDependencyTests-1941571554 None] Lock "cinder-quobyte-42012ab2-a101-4cdb-926b-29cf3c976b57" released by "delete_volume" :: held 0.822s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:08 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-94fb7017-e571-4e83-a4fa-c4f317860038 tempest-VolumeImageDependencyTests-1941571554 None] Created reservations ['5bcb5b8e-134f-4152-a4aa-a68ed7fb82fa', '92d5eef3-0213-4025-9e5d-056dc7fae0f4', 'eb70159e-7690-48d9-ba8d-ed195d8634fd', '2f4e05b2-c346-4f66-9283-fb390a9bc209'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:21:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-94fb7017-e571-4e83-a4fa-c4f317860038 tempest-VolumeImageDependencyTests-1941571554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-94fb7017-e571-4e83-a4fa-c4f317860038 tempest-VolumeImageDependencyTests-1941571554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-94fb7017-e571-4e83-a4fa-c4f317860038 tempest-VolumeImageDependencyTests-1941571554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:21:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-94fb7017-e571-4e83-a4fa-c4f317860038 tempest-VolumeImageDependencyTests-1941571554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:21:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-94fb7017-e571-4e83-a4fa-c4f317860038 tempest-VolumeImageDependencyTests-1941571554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-94fb7017-e571-4e83-a4fa-c4f317860038 tempest-VolumeImageDependencyTests-1941571554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:08 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:21:08 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:09 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-94fb7017-e571-4e83-a4fa-c4f317860038 tempest-VolumeImageDependencyTests-1941571554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.348s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:09 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-94fb7017-e571-4e83-a4fa-c4f317860038 tempest-VolumeImageDependencyTests-1941571554 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:21:09 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-94fb7017-e571-4e83-a4fa-c4f317860038 tempest-VolumeImageDependencyTests-1941571554 None] Deleted volume successfully. Sep 25 17:21:09 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-94fb7017-e571-4e83-a4fa-c4f317860038 tempest-VolumeImageDependencyTests-1941571554 None] Lock "cinder-42012ab2-a101-4cdb-926b-29cf3c976b57-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:13 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:21:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Flow 'volume_create_manager' (bf6b8259-d75f-402a-9867-de07a5e1ae5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:21:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea87f46-318b-4fc8-8899-d43f86d2f047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea87f46-318b-4fc8-8899-d43f86d2f047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2010796621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1547fda4-6841-40b4-9376-90fb39969bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd07737bca24d0887ca72507fe5f611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:14Z,use_quota=True,user_id='035854f6795b485abf0911068467424c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418c6559-2825-4d62-ac40-6f9d703eee94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418c6559-2825-4d62-ac40-6f9d703eee94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc4b731-0161-40b4-8fd0-43e203e7c8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc4b731-0161-40b4-8fd0-43e203e7c8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1547fda4-6841-40b4-9376-90fb39969bce', 'volume_name': 'volume-1547fda4-6841-40b4-9376-90fb39969bce', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd80456-9d62-4005-a937-530f4f4ee18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd80456-9d62-4005-a937-530f4f4ee18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f4e622c-627e-4254-9a9c-effbdff4b898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:13 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Volume 1547fda4-6841-40b4-9376-90fb39969bce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1547fda4-6841-40b4-9376-90fb39969bce', 'volume_size': 1} Sep 25 17:21:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2010796621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1547fda4-6841-40b4-9376-90fb39969bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd07737bca24d0887ca72507fe5f611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:14Z,use_quota=True,user_id='035854f6795b485abf0911068467424c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:21:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Creating volume 1547fda4-6841-40b4-9376-90fb39969bce {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:21:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:21:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:21:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:21:13 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:21:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1547fda4-6841-40b4-9376-90fb39969bce 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:13 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1547fda4-6841-40b4-9376-90fb39969bce 1073741824 Sep 25 17:21:13 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:14 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1547fda4-6841-40b4-9376-90fb39969bce 1073741824" returned: 0 in 0.530s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1547fda4-6841-40b4-9376-90fb39969bce {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:14 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1547fda4-6841-40b4-9376-90fb39969bce Sep 25 17:21:14 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:14 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1547fda4-6841-40b4-9376-90fb39969bce" returned: 0 in 0.287s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:21:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f4e622c-627e-4254-9a9c-effbdff4b898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1547fda4-6841-40b4-9376-90fb39969bce', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd290236-499b-4cd8-9479-f2fa8042f2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:14 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Volume volume-1547fda4-6841-40b4-9376-90fb39969bce (1547fda4-6841-40b4-9376-90fb39969bce): created successfully Sep 25 17:21:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd290236-499b-4cd8-9479-f2fa8042f2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Flow 'volume_create_manager' (bf6b8259-d75f-402a-9867-de07a5e1ae5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:21:14 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-615c311c-bdfb-4d12-83ef-2b39a6ecad47 tempest-ProjectReaderTests-522443988 None] Created volume successfully. Sep 25 17:21:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-276a68fb-3ea3-4bab-ae06-c5aad38e0e9f req-03f69413-0b25-49d1-9b29-bf08c261f8f5 tempest-TestStampPattern-2048838673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-276a68fb-3ea3-4bab-ae06-c5aad38e0e9f req-03f69413-0b25-49d1-9b29-bf08c261f8f5 tempest-TestStampPattern-2048838673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-276a68fb-3ea3-4bab-ae06-c5aad38e0e9f req-03f69413-0b25-49d1-9b29-bf08c261f8f5 tempest-TestStampPattern-2048838673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-276a68fb-3ea3-4bab-ae06-c5aad38e0e9f req-03f69413-0b25-49d1-9b29-bf08c261f8f5 tempest-TestStampPattern-2048838673 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a9432a3-a0c2-4bfb-8ce7-a7d0b4eaace0', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:21:16 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-276a68fb-3ea3-4bab-ae06-c5aad38e0e9f req-03f69413-0b25-49d1-9b29-bf08c261f8f5 tempest-TestStampPattern-2048838673 None] attachment_update completed successfully. Sep 25 17:21:16 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f8b70275-0373-4f85-bba4-cb2997c45886 tempest-ProjectReaderTests-522443988 None] Acquiring lock "cinder-1547fda4-6841-40b4-9376-90fb39969bce-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:16 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f8b70275-0373-4f85-bba4-cb2997c45886 tempest-ProjectReaderTests-522443988 None] Lock "cinder-1547fda4-6841-40b4-9376-90fb39969bce-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:16 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f8b70275-0373-4f85-bba4-cb2997c45886 tempest-ProjectReaderTests-522443988 None] Acquiring lock "cinder-quobyte-1547fda4-6841-40b4-9376-90fb39969bce" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:16 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f8b70275-0373-4f85-bba4-cb2997c45886 tempest-ProjectReaderTests-522443988 None] Lock "cinder-quobyte-1547fda4-6841-40b4-9376-90fb39969bce" acquired by "delete_volume" :: waited 0.036s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:16 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d60170-8b95-436d-8478-c8b2c8678066]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f8b70275-0373-4f85-bba4-cb2997c45886 tempest-ProjectReaderTests-522443988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1547fda4-6841-40b4-9376-90fb39969bce {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:17 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1547fda4-6841-40b4-9376-90fb39969bce Sep 25 17:21:17 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:17 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f8b70275-0373-4f85-bba4-cb2997c45886 tempest-ProjectReaderTests-522443988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1547fda4-6841-40b4-9376-90fb39969bce" returned: 0 in 0.542s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f8b70275-0373-4f85-bba4-cb2997c45886 tempest-ProjectReaderTests-522443988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1547fda4-6841-40b4-9376-90fb39969bce {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:17 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1547fda4-6841-40b4-9376-90fb39969bce Sep 25 17:21:17 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:17 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f8b70275-0373-4f85-bba4-cb2997c45886 tempest-ProjectReaderTests-522443988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1547fda4-6841-40b4-9376-90fb39969bce" returned: 0 in 0.344s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f8b70275-0373-4f85-bba4-cb2997c45886 tempest-ProjectReaderTests-522443988 None] Lock "cinder-quobyte-1547fda4-6841-40b4-9376-90fb39969bce" released by "delete_volume" :: held 0.968s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:17 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-f8b70275-0373-4f85-bba4-cb2997c45886 tempest-ProjectReaderTests-522443988 None] Created reservations ['5d55f279-9f21-4acc-b679-288adf026b3e', '8baf47ec-9cdc-4a10-a1f9-c84398086bda', '165dd3a8-1ac1-4c02-b13e-4444973b542c', '3ef31113-9d9a-4668-800b-facdc0f1e375'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:21:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f8b70275-0373-4f85-bba4-cb2997c45886 tempest-ProjectReaderTests-522443988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f8b70275-0373-4f85-bba4-cb2997c45886 tempest-ProjectReaderTests-522443988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f8b70275-0373-4f85-bba4-cb2997c45886 tempest-ProjectReaderTests-522443988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:21:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f8b70275-0373-4f85-bba4-cb2997c45886 tempest-ProjectReaderTests-522443988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:21:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f8b70275-0373-4f85-bba4-cb2997c45886 tempest-ProjectReaderTests-522443988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f8b70275-0373-4f85-bba4-cb2997c45886 tempest-ProjectReaderTests-522443988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:17 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:21:17 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:18 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f8b70275-0373-4f85-bba4-cb2997c45886 tempest-ProjectReaderTests-522443988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.310s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:18 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-f8b70275-0373-4f85-bba4-cb2997c45886 tempest-ProjectReaderTests-522443988 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:21:18 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-f8b70275-0373-4f85-bba4-cb2997c45886 tempest-ProjectReaderTests-522443988 None] Deleted volume successfully. Sep 25 17:21:18 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f8b70275-0373-4f85-bba4-cb2997c45886 tempest-ProjectReaderTests-522443988 None] Lock "cinder-1547fda4-6841-40b4-9376-90fb39969bce-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:19 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:21:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Flow 'volume_create_manager' (c600f82f-bbd6-4986-b84e-ca5b7b4f84c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:21:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53298ed4-7828-48f9-a6a1-4560a34d849d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53298ed4-7828-48f9-a6a1-4560a34d849d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-993899691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97b05f2-b813-4356-bca7-1478c60e4a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd07737bca24d0887ca72507fe5f611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:19Z,use_quota=True,user_id='035854f6795b485abf0911068467424c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb7419d-0f2f-4856-bd24-7e91b64c28fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb7419d-0f2f-4856-bd24-7e91b64c28fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f30fad-c75e-4679-b780-b37c913ed1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f30fad-c75e-4679-b780-b37c913ed1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd97b05f2-b813-4356-bca7-1478c60e4a55', 'volume_name': 'volume-d97b05f2-b813-4356-bca7-1478c60e4a55', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f36ac88-0d4d-4c14-a4f7-562c9fc07d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f36ac88-0d4d-4c14-a4f7-562c9fc07d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae4d5d40-9ae8-4e1d-9730-3d8f88e14cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:19 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Volume d97b05f2-b813-4356-bca7-1478c60e4a55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d97b05f2-b813-4356-bca7-1478c60e4a55', 'volume_size': 1} Sep 25 17:21:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-993899691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97b05f2-b813-4356-bca7-1478c60e4a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd07737bca24d0887ca72507fe5f611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:19Z,use_quota=True,user_id='035854f6795b485abf0911068467424c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:21:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Creating volume d97b05f2-b813-4356-bca7-1478c60e4a55 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:21:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:21:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:21:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:21:19 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:21:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d97b05f2-b813-4356-bca7-1478c60e4a55 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:19 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d97b05f2-b813-4356-bca7-1478c60e4a55 1073741824 Sep 25 17:21:19 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:20 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d97b05f2-b813-4356-bca7-1478c60e4a55 1073741824" returned: 0 in 0.513s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d97b05f2-b813-4356-bca7-1478c60e4a55 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:20 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d97b05f2-b813-4356-bca7-1478c60e4a55 Sep 25 17:21:20 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:20 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d97b05f2-b813-4356-bca7-1478c60e4a55" returned: 0 in 0.309s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:20 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:21:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae4d5d40-9ae8-4e1d-9730-3d8f88e14cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d97b05f2-b813-4356-bca7-1478c60e4a55', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873463c0-7179-4572-8ccb-0602c96ad394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:20 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Volume volume-d97b05f2-b813-4356-bca7-1478c60e4a55 (d97b05f2-b813-4356-bca7-1478c60e4a55): created successfully Sep 25 17:21:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873463c0-7179-4572-8ccb-0602c96ad394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Flow 'volume_create_manager' (c600f82f-bbd6-4986-b84e-ca5b7b4f84c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:21:20 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-230081cb-a46a-48c1-9f2c-db5ac9ceb3a5 tempest-ProjectReaderTests-522443988 None] Created volume successfully. Sep 25 17:21:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6f611cc6-f986-4682-9fed-f356faaac3d6 tempest-ProjectReaderTests-522443988 None] Acquiring lock "cinder-d97b05f2-b813-4356-bca7-1478c60e4a55-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6f611cc6-f986-4682-9fed-f356faaac3d6 tempest-ProjectReaderTests-522443988 None] Lock "cinder-d97b05f2-b813-4356-bca7-1478c60e4a55-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6f611cc6-f986-4682-9fed-f356faaac3d6 tempest-ProjectReaderTests-522443988 None] Acquiring lock "cinder-quobyte-d97b05f2-b813-4356-bca7-1478c60e4a55" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6f611cc6-f986-4682-9fed-f356faaac3d6 tempest-ProjectReaderTests-522443988 None] Lock "cinder-quobyte-d97b05f2-b813-4356-bca7-1478c60e4a55" acquired by "delete_volume" :: waited 0.024s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:21 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[33286080-3cf9-4844-8089-8743cab1cf3e]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6f611cc6-f986-4682-9fed-f356faaac3d6 tempest-ProjectReaderTests-522443988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d97b05f2-b813-4356-bca7-1478c60e4a55 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:21 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d97b05f2-b813-4356-bca7-1478c60e4a55 Sep 25 17:21:21 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:22 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6f611cc6-f986-4682-9fed-f356faaac3d6 tempest-ProjectReaderTests-522443988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d97b05f2-b813-4356-bca7-1478c60e4a55" returned: 0 in 0.448s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6f611cc6-f986-4682-9fed-f356faaac3d6 tempest-ProjectReaderTests-522443988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d97b05f2-b813-4356-bca7-1478c60e4a55 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:22 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d97b05f2-b813-4356-bca7-1478c60e4a55 Sep 25 17:21:22 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:22 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6f611cc6-f986-4682-9fed-f356faaac3d6 tempest-ProjectReaderTests-522443988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d97b05f2-b813-4356-bca7-1478c60e4a55" returned: 0 in 0.317s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6f611cc6-f986-4682-9fed-f356faaac3d6 tempest-ProjectReaderTests-522443988 None] Lock "cinder-quobyte-d97b05f2-b813-4356-bca7-1478c60e4a55" released by "delete_volume" :: held 0.839s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:22 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-6f611cc6-f986-4682-9fed-f356faaac3d6 tempest-ProjectReaderTests-522443988 None] Created reservations ['d0ba1440-c35d-41ec-ba87-92df338c9c0b', '027718b3-6ff3-465e-90a4-17e8f7256783', '59f48a42-6414-474f-be2f-949f1a1bf419', '145981f7-fb6a-4f3d-82d7-20a9462dea7a'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:21:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6f611cc6-f986-4682-9fed-f356faaac3d6 tempest-ProjectReaderTests-522443988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6f611cc6-f986-4682-9fed-f356faaac3d6 tempest-ProjectReaderTests-522443988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6f611cc6-f986-4682-9fed-f356faaac3d6 tempest-ProjectReaderTests-522443988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:21:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6f611cc6-f986-4682-9fed-f356faaac3d6 tempest-ProjectReaderTests-522443988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:21:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6f611cc6-f986-4682-9fed-f356faaac3d6 tempest-ProjectReaderTests-522443988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6f611cc6-f986-4682-9fed-f356faaac3d6 tempest-ProjectReaderTests-522443988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:22 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:21:22 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:22 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-edfc8b87-cfde-46bf-a7b2-08c6857a93c2 req-85b86f32-677a-469f-af0c-2c422ff0276c tempest-TestStampPattern-2048838673 None] Terminate volume connection completed successfully. Sep 25 17:21:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-edfc8b87-cfde-46bf-a7b2-08c6857a93c2 req-85b86f32-677a-469f-af0c-2c422ff0276c tempest-TestStampPattern-2048838673 None] Deleting attachment 6a9432a3-a0c2-4bfb-8ce7-a7d0b4eaace0. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:21:23 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6f611cc6-f986-4682-9fed-f356faaac3d6 tempest-ProjectReaderTests-522443988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.356s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:23 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-6f611cc6-f986-4682-9fed-f356faaac3d6 tempest-ProjectReaderTests-522443988 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:21:23 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-6f611cc6-f986-4682-9fed-f356faaac3d6 tempest-ProjectReaderTests-522443988 None] Deleted volume successfully. Sep 25 17:21:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6f611cc6-f986-4682-9fed-f356faaac3d6 tempest-ProjectReaderTests-522443988 None] Lock "cinder-d97b05f2-b813-4356-bca7-1478c60e4a55-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-fe45ddb8-e357-4b09-b84e-2291151fdb82 tempest-TestStampPattern-2048838673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-fe45ddb8-e357-4b09-b84e-2291151fdb82 tempest-TestStampPattern-2048838673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-fe45ddb8-e357-4b09-b84e-2291151fdb82 tempest-TestStampPattern-2048838673 None] Creating offline snapshot 6903a710-1d0f-4560-a527-2684461e1b6b of volume 1b27aa9e-bd71-46f9-b605-6e9f84af9503 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:21:23 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b79444-4e65-4c04-a9dc-9e7183067348]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fe45ddb8-e357-4b09-b84e-2291151fdb82 tempest-TestStampPattern-2048838673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:24 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 Sep 25 17:21:24 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:24 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fe45ddb8-e357-4b09-b84e-2291151fdb82 tempest-TestStampPattern-2048838673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503" returned: 0 in 0.589s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fe45ddb8-e357-4b09-b84e-2291151fdb82 tempest-TestStampPattern-2048838673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:24 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b 1G Sep 25 17:21:24 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:25 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fe45ddb8-e357-4b09-b84e-2291151fdb82 tempest-TestStampPattern-2048838673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b 1G" returned: 0 in 0.580s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fe45ddb8-e357-4b09-b84e-2291151fdb82 tempest-TestStampPattern-2048838673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:25 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b Sep 25 17:21:25 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:25 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fe45ddb8-e357-4b09-b84e-2291151fdb82 tempest-TestStampPattern-2048838673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b" returned: 0 in 0.385s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:25 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-fe45ddb8-e357-4b09-b84e-2291151fdb82 tempest-TestStampPattern-2048838673 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b is being set with open permissions: ugo+rw Sep 25 17:21:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fe45ddb8-e357-4b09-b84e-2291151fdb82 tempest-TestStampPattern-2048838673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:25 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b Sep 25 17:21:25 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:25 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fe45ddb8-e357-4b09-b84e-2291151fdb82 tempest-TestStampPattern-2048838673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b" returned: 0 in 0.296s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fe45ddb8-e357-4b09-b84e-2291151fdb82 tempest-TestStampPattern-2048838673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:25 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.info Sep 25 17:21:25 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:26 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fe45ddb8-e357-4b09-b84e-2291151fdb82 tempest-TestStampPattern-2048838673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.info" returned: 0 in 0.294s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:26 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-fe45ddb8-e357-4b09-b84e-2291151fdb82 tempest-TestStampPattern-2048838673 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.info is being set with open permissions: ugo+rw Sep 25 17:21:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fe45ddb8-e357-4b09-b84e-2291151fdb82 tempest-TestStampPattern-2048838673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:26 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.info Sep 25 17:21:26 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:26 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fe45ddb8-e357-4b09-b84e-2291151fdb82 tempest-TestStampPattern-2048838673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.info" returned: 0 in 0.291s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-fe45ddb8-e357-4b09-b84e-2291151fdb82 tempest-TestStampPattern-2048838673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.592s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:26 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-fe45ddb8-e357-4b09-b84e-2291151fdb82 tempest-TestStampPattern-2048838673 None] Create snapshot completed successfully Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Flow 'volume_create_manager' (782e68f1-52b4-4dd0-a12a-34c04621f778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ce2f2f-654e-4aee-985e-eb860debf731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ce2f2f-654e-4aee-985e-eb860debf731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-499399419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7ca331-659c-4656-959b-2417325c5ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba469741d424f5296bbce28b534135d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:32Z,use_quota=True,user_id='de0089eb89544dfb8e07abfab54e6de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d323052-9c3f-4b8a-94eb-b27fa2b51061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d323052-9c3f-4b8a-94eb-b27fa2b51061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f566feca-73b0-4f81-b0c1-e19c786b5700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f566feca-73b0-4f81-b0c1-e19c786b5700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a7ca331-659c-4656-959b-2417325c5ca3', 'volume_name': 'volume-7a7ca331-659c-4656-959b-2417325c5ca3', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7afea02b-80f5-459d-99c5-95744012bca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7afea02b-80f5-459d-99c5-95744012bca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d9d647-5d6c-4a6b-9a83-95582e6d02f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:32 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Volume 7a7ca331-659c-4656-959b-2417325c5ca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a7ca331-659c-4656-959b-2417325c5ca3', 'volume_size': 1} Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-499399419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7ca331-659c-4656-959b-2417325c5ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba469741d424f5296bbce28b534135d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:32Z,use_quota=True,user_id='de0089eb89544dfb8e07abfab54e6de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Creating volume 7a7ca331-659c-4656-959b-2417325c5ca3 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:21:32 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:32 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3 1073741824 Sep 25 17:21:32 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:32 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3 1073741824" returned: 0 in 0.545s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:32 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3 Sep 25 17:21:32 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:33 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3" returned: 0 in 0.315s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:21:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d9d647-5d6c-4a6b-9a83-95582e6d02f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a7ca331-659c-4656-959b-2417325c5ca3', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6250ff4-1553-4519-bb23-c8523699910a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:33 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Volume volume-7a7ca331-659c-4656-959b-2417325c5ca3 (7a7ca331-659c-4656-959b-2417325c5ca3): created successfully Sep 25 17:21:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6250ff4-1553-4519-bb23-c8523699910a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Flow 'volume_create_manager' (782e68f1-52b4-4dd0-a12a-34c04621f778) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:21:33 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-88f3803f-5427-44c4-9648-61eab11bde96 tempest-VolumesDeleteCascade-1966557968 None] Created volume successfully. Sep 25 17:21:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-aab19c29-dee7-4668-8189-3760611e8458 tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-aab19c29-dee7-4668-8189-3760611e8458 tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-aab19c29-dee7-4668-8189-3760611e8458 tempest-VolumesDeleteCascade-1966557968 None] Creating offline snapshot 013d02c8-1c9d-4365-aa8f-770815713a32 of volume 7a7ca331-659c-4656-959b-2417325c5ca3 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:21:34 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[281d857d-aee4-4543-ba5f-f6a5f42d7093]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aab19c29-dee7-4668-8189-3760611e8458 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:34 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3 Sep 25 17:21:34 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:34 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aab19c29-dee7-4668-8189-3760611e8458 tempest-VolumesDeleteCascade-1966557968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3" returned: 0 in 0.468s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aab19c29-dee7-4668-8189-3760611e8458 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:34 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32 1G Sep 25 17:21:34 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:35 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:21:35 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aab19c29-dee7-4668-8189-3760611e8458 tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32 1G" returned: 0 in 0.560s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aab19c29-dee7-4668-8189-3760611e8458 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a7ca331-659c-4656-959b-2417325c5ca3 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:35 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a7ca331-659c-4656-959b-2417325c5ca3 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32 Sep 25 17:21:35 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Flow 'volume_create_manager' (c1856ff4-9bed-4dcd-ab78-bbbdc326ef3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:21:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3936b6c-3103-44c1-8e0b-2e7d77819b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3936b6c-3103-44c1-8e0b-2e7d77819b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-256814723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94856d40-2618-47fc-a70d-0d52504e760d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a4f7d46c40446449086b06b2507a3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6903a710-1d0f-4560-a527-2684461e1b6b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:35Z,use_quota=True,user_id='b6d666ab32b142d581994aedb2e0f54b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f71acaf-fd3b-4a48-acac-7ff5b265284c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f71acaf-fd3b-4a48-acac-7ff5b265284c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b848e819-f9b1-4c3d-af7c-cc013bdd4625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b848e819-f9b1-4c3d-af7c-cc013bdd4625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '94856d40-2618-47fc-a70d-0d52504e760d', 'volume_name': 'volume-94856d40-2618-47fc-a70d-0d52504e760d', 'volume_size': 1, 'snapshot_id': '6903a710-1d0f-4560-a527-2684461e1b6b'}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569146f2-4362-400c-b197-32c1a7274632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569146f2-4362-400c-b197-32c1a7274632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:35 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c38e9cb-f26d-4dc4-b3db-3dc355285fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:35 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Volume 94856d40-2618-47fc-a70d-0d52504e760d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-94856d40-2618-47fc-a70d-0d52504e760d', 'volume_size': 1, 'snapshot_id': '6903a710-1d0f-4560-a527-2684461e1b6b'} Sep 25 17:21:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:35 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aab19c29-dee7-4668-8189-3760611e8458 tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a7ca331-659c-4656-959b-2417325c5ca3 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32" returned: 0 in 0.364s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:35 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-aab19c29-dee7-4668-8189-3760611e8458 tempest-VolumesDeleteCascade-1966557968 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32 is being set with open permissions: ugo+rw Sep 25 17:21:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aab19c29-dee7-4668-8189-3760611e8458 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:35 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32 Sep 25 17:21:35 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:36 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aab19c29-dee7-4668-8189-3760611e8458 tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32" returned: 0 in 0.295s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aab19c29-dee7-4668-8189-3760611e8458 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:36 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.info Sep 25 17:21:36 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:36 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aab19c29-dee7-4668-8189-3760611e8458 tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.info" returned: 0 in 0.329s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:36 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-aab19c29-dee7-4668-8189-3760611e8458 tempest-VolumesDeleteCascade-1966557968 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.info is being set with open permissions: ugo+rw Sep 25 17:21:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aab19c29-dee7-4668-8189-3760611e8458 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:36 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.info Sep 25 17:21:36 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:36 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aab19c29-dee7-4668-8189-3760611e8458 tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.info" returned: 0 in 0.439s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-aab19c29-dee7-4668-8189-3760611e8458 tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.579s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.347s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Acquiring lock "cinder-quobyte-6903a710-1d0f-4560-a527-2684461e1b6b-94856d40-2618-47fc-a70d-0d52504e760d" by "_create_volume_from_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Lock "cinder-quobyte-6903a710-1d0f-4560-a527-2684461e1b6b-94856d40-2618-47fc-a70d-0d52504e760d" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Creating volume 94856d40-2618-47fc-a70d-0d52504e760d from snapshot 6903a710-1d0f-4560-a527-2684461e1b6b {{(pid=87211) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Acquiring lock "cinder-quobyte-94856d40-2618-47fc-a70d-0d52504e760d" by "_copy_volume_from_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:37 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-aab19c29-dee7-4668-8189-3760611e8458 tempest-VolumesDeleteCascade-1966557968 None] Create snapshot completed successfully Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Lock "cinder-quobyte-94856d40-2618-47fc-a70d-0d52504e760d" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] snapshot: 6903a710-1d0f-4560-a527-2684461e1b6b, volume: 94856d40-2618-47fc-a70d-0d52504e760d, {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae94d8a-93dc-4888-b900-87126215ea61]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:37 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b Sep 25 17:21:37 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:37 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b" returned: 0 in 0.542s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[a762a439-ccb6-4c38-9608-1a5e7d5f971d]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:37 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 Sep 25 17:21:37 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a5c8d159-a915-4987-b12f-f72725fa822c tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:38 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503" returned: 0 in 0.481s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] will copy from snapshot at /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:21:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Creating direct copy from snapshot {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:21:38 devstack cinder-volume[87211]: DEBUG cinder.utils [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Path /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-94856d40-2618-47fc-a70d-0d52504e760d not found in is_blk_device check {{(pid=87211) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:21:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-94856d40-2618-47fc-a70d-0d52504e760d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:38 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-94856d40-2618-47fc-a70d-0d52504e760d Sep 25 17:21:38 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:41 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:21:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Flow 'volume_create_manager' (385fe139-e745-420e-a851-4fdcb4a38c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:21:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e689513f-25f2-4764-a414-9f44ec8d942a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e689513f-25f2-4764-a414-9f44ec8d942a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1264708067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ce1c2a2-bf4d-43cd-9db8-abe89b100566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efdd7b6949164ebeaca87c32238daa0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:42Z,use_quota=True,user_id='eaeb2c1639e1498cb810a033eb0e99b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797ba950-c65c-4110-86c4-5710c0494635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797ba950-c65c-4110-86c4-5710c0494635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907629e9-96d3-48c0-9ecc-40376810ec56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907629e9-96d3-48c0-9ecc-40376810ec56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ce1c2a2-bf4d-43cd-9db8-abe89b100566', 'volume_name': 'volume-2ce1c2a2-bf4d-43cd-9db8-abe89b100566', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c9d833-3543-4862-a4b3-fca820f3d9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c9d833-3543-4862-a4b3-fca820f3d9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21078b6e-f1c4-4ec9-bf6d-3b2e02e66bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:42 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Volume 2ce1c2a2-bf4d-43cd-9db8-abe89b100566: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ce1c2a2-bf4d-43cd-9db8-abe89b100566', 'volume_size': 1} Sep 25 17:21:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:48 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-94856d40-2618-47fc-a70d-0d52504e760d" returned: 0 in 10.058s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:48 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Image conversion details: src /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503, size 1024.00 MB, duration 10.06 sec, destination /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-94856d40-2618-47fc-a70d-0d52504e760d {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:21:48 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Converted 1024.00 MB image at 101.79 MB/s Sep 25 17:21:48 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-94856d40-2618-47fc-a70d-0d52504e760d is being set with open permissions: ugo+rw Sep 25 17:21:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-94856d40-2618-47fc-a70d-0d52504e760d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:48 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-94856d40-2618-47fc-a70d-0d52504e760d Sep 25 17:21:48 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:48 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-94856d40-2618-47fc-a70d-0d52504e760d" returned: 0 in 0.249s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:48 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Lock "cinder-quobyte-94856d40-2618-47fc-a70d-0d52504e760d" released by "_copy_volume_from_snapshot" :: held 11.445s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:48 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Lock "cinder-quobyte-6903a710-1d0f-4560-a527-2684461e1b6b-94856d40-2618-47fc-a70d-0d52504e760d" released by "_create_volume_from_snapshot" :: held 11.530s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.561s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a5c8d159-a915-4987-b12f-f72725fa822c tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.683s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-a5c8d159-a915-4987-b12f-f72725fa822c tempest-VolumesDeleteCascade-1966557968 None] Creating offline snapshot 11b22c0e-90be-4f7e-befa-3e5e731fc49b of volume 7a7ca331-659c-4656-959b-2417325c5ca3 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:21:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c38e9cb-f26d-4dc4-b3db-3dc355285fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94856d40-2618-47fc-a70d-0d52504e760d', 'volume_size': 1, 'snapshot_id': '6903a710-1d0f-4560-a527-2684461e1b6b'}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc23dd1d-7d35-4c91-872f-8fe37146c6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:48 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b48e75-4719-462e-a29c-ab9134796789]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a5c8d159-a915-4987-b12f-f72725fa822c tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:48 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Volume volume-94856d40-2618-47fc-a70d-0d52504e760d (94856d40-2618-47fc-a70d-0d52504e760d): created successfully Sep 25 17:21:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc23dd1d-7d35-4c91-872f-8fe37146c6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Flow 'volume_create_manager' (c1856ff4-9bed-4dcd-ab78-bbbdc326ef3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:21:48 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-48919a02-10ab-49c8-878e-4f7fe12a6af4 tempest-TestStampPattern-2048838673 None] Created volume successfully. Sep 25 17:21:48 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32 Sep 25 17:21:48 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:49 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a5c8d159-a915-4987-b12f-f72725fa822c tempest-VolumesDeleteCascade-1966557968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32" returned: 0 in 0.488s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-a5c8d159-a915-4987-b12f-f72725fa822c tempest-VolumesDeleteCascade-1966557968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a7ca331-659c-4656-959b-2417325c5ca3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:21:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a5c8d159-a915-4987-b12f-f72725fa822c tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:49 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b 1G Sep 25 17:21:49 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:49 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a5c8d159-a915-4987-b12f-f72725fa822c tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b 1G" returned: 0 in 0.612s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a5c8d159-a915-4987-b12f-f72725fa822c tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:49 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b Sep 25 17:21:49 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:50 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a5c8d159-a915-4987-b12f-f72725fa822c tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b" returned: 0 in 0.334s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:50 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-a5c8d159-a915-4987-b12f-f72725fa822c tempest-VolumesDeleteCascade-1966557968 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b is being set with open permissions: ugo+rw Sep 25 17:21:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a5c8d159-a915-4987-b12f-f72725fa822c tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:50 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b Sep 25 17:21:50 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:50 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a5c8d159-a915-4987-b12f-f72725fa822c tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b" returned: 0 in 0.289s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a5c8d159-a915-4987-b12f-f72725fa822c tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.876s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.308s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1264708067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ce1c2a2-bf4d-43cd-9db8-abe89b100566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efdd7b6949164ebeaca87c32238daa0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:42Z,use_quota=True,user_id='eaeb2c1639e1498cb810a033eb0e99b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:21:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Creating volume 2ce1c2a2-bf4d-43cd-9db8-abe89b100566 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:21:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:21:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:21:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:21:50 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:21:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2ce1c2a2-bf4d-43cd-9db8-abe89b100566 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:50 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2ce1c2a2-bf4d-43cd-9db8-abe89b100566 1073741824 Sep 25 17:21:50 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:50 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-a5c8d159-a915-4987-b12f-f72725fa822c tempest-VolumesDeleteCascade-1966557968 None] Create snapshot completed successfully Sep 25 17:21:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "cinder-7a7ca331-659c-4656-959b-2417325c5ca3-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-7a7ca331-659c-4656-959b-2417325c5ca3-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Performing cascade delete. {{(pid=87211) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 17:21:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "cinder-013d02c8-1c9d-4365-aa8f-770815713a32-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-013d02c8-1c9d-4365-aa8f-770815713a32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "cinder-quobyte-7a7ca331-659c-4656-959b-2417325c5ca3" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-quobyte-7a7ca331-659c-4656-959b-2417325c5ca3" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "cinder-quobyte-013d02c8-1c9d-4365-aa8f-770815713a32" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-quobyte-013d02c8-1c9d-4365-aa8f-770815713a32" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Deleting offline snapshot 013d02c8-1c9d-4365-aa8f-770815713a32 of volume 7a7ca331-659c-4656-959b-2417325c5ca3 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:21:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] snapshot_file for this snap is: volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:21:51 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c49702-d2ec-4c55-a8cc-41c24a275c88]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:51 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2ce1c2a2-bf4d-43cd-9db8-abe89b100566 1073741824" returned: 0 in 0.737s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:51 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32 Sep 25 17:21:51 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:51 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32" returned: 0 in 0.470s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a7ca331-659c-4656-959b-2417325c5ca3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:21:51 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01b9c0e-92a1-4e50-b0b3-5becb2fa3c2a]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:51 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3 Sep 25 17:21:51 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:52 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3" returned: 0 in 0.468s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:52 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee326a21-1713-4d22-898d-d17b52130a84]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:52 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b Sep 25 17:21:52 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:52 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b" returned: 0 in 0.398s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:52 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a7ca331-659c-4656-959b-2417325c5ca3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:21:52 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a824687-70f6-4a3b-9482-428450823109]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:52 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32 Sep 25 17:21:52 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:52 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32" returned: 0 in 0.368s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:52 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a7ca331-659c-4656-959b-2417325c5ca3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:21:52 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d20057-375b-42ef-95b4-cdd37a24467b]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:53 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3 Sep 25 17:21:53 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2ce1c2a2-bf4d-43cd-9db8-abe89b100566 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:53 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2ce1c2a2-bf4d-43cd-9db8-abe89b100566 Sep 25 17:21:53 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:53 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3" returned: 0 in 0.383s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:53 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32 Sep 25 17:21:53 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:53 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2ce1c2a2-bf4d-43cd-9db8-abe89b100566" returned: 0 in 0.277s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] <== create_volume: return (3067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:21:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.074s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:21:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:21:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:21:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:53 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:21:53 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:53 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32" returned: 0 in 0.365s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:53 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32 Sep 25 17:21:53 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:53 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.279s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:53 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:21:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:21:53 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 28 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:21:53 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:21:54 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.013d02c8-1c9d-4365-aa8f-770815713a32" returned: 0 in 0.301s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a7ca331-659c-4656-959b-2417325c5ca3 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b -F qcow2 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:54 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a7ca331-659c-4656-959b-2417325c5ca3 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b -F qcow2 Sep 25 17:21:54 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:54 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a7ca331-659c-4656-959b-2417325c5ca3 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b -F qcow2" returned: 0 in 0.347s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-quobyte-013d02c8-1c9d-4365-aa8f-770815713a32" released by "_delete_snapshot" :: held 3.318s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-quobyte-7a7ca331-659c-4656-959b-2417325c5ca3" released by "delete_snapshot" :: held 3.355s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21078b6e-f1c4-4ec9-bf6d-3b2e02e66bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ce1c2a2-bf4d-43cd-9db8-abe89b100566', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915cf822-e701-45fa-b512-49662d54f236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:21:56 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Volume volume-2ce1c2a2-bf4d-43cd-9db8-abe89b100566 (2ce1c2a2-bf4d-43cd-9db8-abe89b100566): created successfully Sep 25 17:21:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915cf822-e701-45fa-b512-49662d54f236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:21:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Flow 'volume_create_manager' (385fe139-e745-420e-a851-4fdcb4a38c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:21:56 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-230caf5f-a3f4-42c7-ae0f-3a7f11ad5fbf tempest-ProjectReaderTests-930602704 None] Created volume successfully. Sep 25 17:21:56 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Created reservations ['cea450f4-391e-43c2-9041-ba6bc3390f6d', 'ac837b9a-e910-4451-9e4f-bc868ac4bd73', '09e46309-1fcb-49c1-9c9b-6221bd1171bc', 'c047d771-d7dd-4975-949d-82470c06b2ec'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:21:56 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Delete snapshot completed successfully. Sep 25 17:21:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-013d02c8-1c9d-4365-aa8f-770815713a32-delete_snapshot" released by "delete_snapshot" :: held 5.828s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "cinder-11b22c0e-90be-4f7e-befa-3e5e731fc49b-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-11b22c0e-90be-4f7e-befa-3e5e731fc49b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "cinder-quobyte-7a7ca331-659c-4656-959b-2417325c5ca3" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-quobyte-7a7ca331-659c-4656-959b-2417325c5ca3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "cinder-quobyte-11b22c0e-90be-4f7e-befa-3e5e731fc49b" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-quobyte-11b22c0e-90be-4f7e-befa-3e5e731fc49b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Deleting offline snapshot 11b22c0e-90be-4f7e-befa-3e5e731fc49b of volume 7a7ca331-659c-4656-959b-2417325c5ca3 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:21:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] snapshot_file for this snap is: volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:21:56 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4995c185-b319-4a3a-9bbc-0be4e2198297]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:57 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b Sep 25 17:21:57 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:57 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b" returned: 0 in 0.507s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a7ca331-659c-4656-959b-2417325c5ca3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:21:57 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f614c55-3f6f-4a8b-ac92-760e4d034541]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:57 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3 Sep 25 17:21:57 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:58 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3" returned: 0 in 0.594s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:58 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b Sep 25 17:21:58 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eed872bd-c8c9-4205-a410-d89e55466571 tempest-ProjectReaderTests-930602704 None] Acquiring lock "cinder-2ce1c2a2-bf4d-43cd-9db8-abe89b100566-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eed872bd-c8c9-4205-a410-d89e55466571 tempest-ProjectReaderTests-930602704 None] Lock "cinder-2ce1c2a2-bf4d-43cd-9db8-abe89b100566-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eed872bd-c8c9-4205-a410-d89e55466571 tempest-ProjectReaderTests-930602704 None] Acquiring lock "cinder-quobyte-2ce1c2a2-bf4d-43cd-9db8-abe89b100566" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eed872bd-c8c9-4205-a410-d89e55466571 tempest-ProjectReaderTests-930602704 None] Lock "cinder-quobyte-2ce1c2a2-bf4d-43cd-9db8-abe89b100566" acquired by "delete_volume" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:58 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[7081c19b-8743-4305-afcc-2eb7e4ded097]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eed872bd-c8c9-4205-a410-d89e55466571 tempest-ProjectReaderTests-930602704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2ce1c2a2-bf4d-43cd-9db8-abe89b100566 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:58 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2ce1c2a2-bf4d-43cd-9db8-abe89b100566 Sep 25 17:21:58 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:58 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b" returned: 0 in 0.637s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:58 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b Sep 25 17:21:58 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:59 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eed872bd-c8c9-4205-a410-d89e55466571 tempest-ProjectReaderTests-930602704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2ce1c2a2-bf4d-43cd-9db8-abe89b100566" returned: 0 in 0.546s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eed872bd-c8c9-4205-a410-d89e55466571 tempest-ProjectReaderTests-930602704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2ce1c2a2-bf4d-43cd-9db8-abe89b100566 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:59 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2ce1c2a2-bf4d-43cd-9db8-abe89b100566 Sep 25 17:21:59 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:59 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3.11b22c0e-90be-4f7e-befa-3e5e731fc49b" returned: 0 in 0.325s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-quobyte-11b22c0e-90be-4f7e-befa-3e5e731fc49b" released by "_delete_snapshot" :: held 2.223s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-quobyte-7a7ca331-659c-4656-959b-2417325c5ca3" released by "delete_snapshot" :: held 2.257s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Created reservations ['af35efc1-9fda-4409-9e1e-7d3ef8ee267b', '3363eff7-5024-4916-aca9-e3f53bb0e296', '262fd8d9-4b18-4524-a728-b54e66c7ea8c', '12096ba9-96f8-42b9-b0d8-0a7ef5eb9353'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:21:59 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Delete snapshot completed successfully. Sep 25 17:21:59 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eed872bd-c8c9-4205-a410-d89e55466571 tempest-ProjectReaderTests-930602704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2ce1c2a2-bf4d-43cd-9db8-abe89b100566" returned: 0 in 0.357s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-11b22c0e-90be-4f7e-befa-3e5e731fc49b-delete_snapshot" released by "delete_snapshot" :: held 2.562s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Snapshots deleted, issuing volume delete {{(pid=87211) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "cinder-quobyte-7a7ca331-659c-4656-959b-2417325c5ca3" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eed872bd-c8c9-4205-a410-d89e55466571 tempest-ProjectReaderTests-930602704 None] Lock "cinder-quobyte-2ce1c2a2-bf4d-43cd-9db8-abe89b100566" released by "delete_volume" :: held 0.990s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-quobyte-7a7ca331-659c-4656-959b-2417325c5ca3" acquired by "delete_volume" :: waited 0.038s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f440305-2bd1-4215-890e-26ede56debb2]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-eed872bd-c8c9-4205-a410-d89e55466571 tempest-ProjectReaderTests-930602704 None] Created reservations ['0f218c2e-598a-4a6e-a72e-d1c5db685851', '7c6acda4-14f1-48fb-b5d7-908ec68a0e84', 'b841adda-fed3-43e6-a23a-1ecb1bffd579', '8c595942-f5ba-4859-b947-ff052f3b21f5'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:21:59 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3 Sep 25 17:21:59 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eed872bd-c8c9-4205-a410-d89e55466571 tempest-ProjectReaderTests-930602704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eed872bd-c8c9-4205-a410-d89e55466571 tempest-ProjectReaderTests-930602704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-eed872bd-c8c9-4205-a410-d89e55466571 tempest-ProjectReaderTests-930602704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-eed872bd-c8c9-4205-a410-d89e55466571 tempest-ProjectReaderTests-930602704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-eed872bd-c8c9-4205-a410-d89e55466571 tempest-ProjectReaderTests-930602704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eed872bd-c8c9-4205-a410-d89e55466571 tempest-ProjectReaderTests-930602704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:59 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:21:59 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:59 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3" returned: 0 in 0.430s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:00 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-eed872bd-c8c9-4205-a410-d89e55466571 tempest-ProjectReaderTests-930602704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.295s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:00 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-eed872bd-c8c9-4205-a410-d89e55466571 tempest-ProjectReaderTests-930602704 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:22:00 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3 Sep 25 17:22:00 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:00 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-eed872bd-c8c9-4205-a410-d89e55466571 tempest-ProjectReaderTests-930602704 None] Deleted volume successfully. Sep 25 17:22:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-eed872bd-c8c9-4205-a410-d89e55466571 tempest-ProjectReaderTests-930602704 None] Lock "cinder-2ce1c2a2-bf4d-43cd-9db8-abe89b100566-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:00 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7a7ca331-659c-4656-959b-2417325c5ca3" returned: 0 in 0.285s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-quobyte-7a7ca331-659c-4656-959b-2417325c5ca3" released by "delete_volume" :: held 0.790s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:00 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Created reservations ['777ff114-3ff3-4832-a2d2-33df2ac2e495', 'a472fba6-2d1c-4a18-a7e0-d4e5f0cd6244', '088966bf-3571-44eb-a1bf-cded14f3d5bf', 'a0dbc61a-c91e-4f63-8ba2-edab675c4930'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:22:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:00 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:22:00 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:22:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:00 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:22:00 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:00 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.282s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:00 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:22:00 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Deleted volume successfully. Sep 25 17:22:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-376980bc-cc08-4195-96d5-21ef34837efc tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-7a7ca331-659c-4656-959b-2417325c5ca3-delete_volume" released by "delete_volume" :: held 9.848s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Flow 'volume_create_manager' (1e0438ff-9b04-4bf2-86cb-0e7ccbee269d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (469533c8-7875-4fba-ae49-1b89c137e1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (469533c8-7875-4fba-ae49-1b89c137e1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1584243183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72e060e-45c2-466a-a79a-a7fd3508148b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efdd7b6949164ebeaca87c32238daa0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:01Z,use_quota=True,user_id='eaeb2c1639e1498cb810a033eb0e99b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb67f8f0-7722-42e0-b141-adcf526386fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb67f8f0-7722-42e0-b141-adcf526386fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1d8f15-a6ed-413b-93b6-90c21cdf14ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1d8f15-a6ed-413b-93b6-90c21cdf14ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e72e060e-45c2-466a-a79a-a7fd3508148b', 'volume_name': 'volume-e72e060e-45c2-466a-a79a-a7fd3508148b', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355f8177-56d2-45ba-a5d9-5c6666f7be7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355f8177-56d2-45ba-a5d9-5c6666f7be7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f6aabc2-a030-42f4-8442-73105a46fd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:01 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Volume e72e060e-45c2-466a-a79a-a7fd3508148b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e72e060e-45c2-466a-a79a-a7fd3508148b', 'volume_size': 1} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1584243183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72e060e-45c2-466a-a79a-a7fd3508148b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efdd7b6949164ebeaca87c32238daa0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:01Z,use_quota=True,user_id='eaeb2c1639e1498cb810a033eb0e99b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Creating volume e72e060e-45c2-466a-a79a-a7fd3508148b {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:22:01 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e72e060e-45c2-466a-a79a-a7fd3508148b 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:01 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e72e060e-45c2-466a-a79a-a7fd3508148b 1073741824 Sep 25 17:22:01 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Flow 'volume_create_manager' (d6ed3f7d-8a98-4196-b036-13b4cf24e9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e33700-83e7-4817-b7f1-9c809bf272b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e33700-83e7-4817-b7f1-9c809bf272b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1703891809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34542998-180f-45ad-9870-15fa8469b1d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba469741d424f5296bbce28b534135d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:02Z,use_quota=True,user_id='de0089eb89544dfb8e07abfab54e6de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9e4e01-7d1d-474e-b390-550e787e86a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9e4e01-7d1d-474e-b390-550e787e86a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af35b867-4e68-4a3a-9195-6d5bf3ea6a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af35b867-4e68-4a3a-9195-6d5bf3ea6a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34542998-180f-45ad-9870-15fa8469b1d0', 'volume_name': 'volume-34542998-180f-45ad-9870-15fa8469b1d0', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98df3fc1-6879-45c0-a304-0c093fed1bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98df3fc1-6879-45c0-a304-0c093fed1bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52fc1fb7-979f-4c98-9e72-f5518970bdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:01 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Volume 34542998-180f-45ad-9870-15fa8469b1d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34542998-180f-45ad-9870-15fa8469b1d0', 'volume_size': 1} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:01 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e72e060e-45c2-466a-a79a-a7fd3508148b 1073741824" returned: 0 in 0.578s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e72e060e-45c2-466a-a79a-a7fd3508148b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:01 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e72e060e-45c2-466a-a79a-a7fd3508148b Sep 25 17:22:02 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:02 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e72e060e-45c2-466a-a79a-a7fd3508148b" returned: 0 in 0.284s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:22:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.351s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1703891809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34542998-180f-45ad-9870-15fa8469b1d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba469741d424f5296bbce28b534135d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:02Z,use_quota=True,user_id='de0089eb89544dfb8e07abfab54e6de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:22:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Creating volume 34542998-180f-45ad-9870-15fa8469b1d0 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:22:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:22:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:22:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:22:02 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:22:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f6aabc2-a030-42f4-8442-73105a46fd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e72e060e-45c2-466a-a79a-a7fd3508148b', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:02 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0 1073741824 Sep 25 17:22:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a1ef73e-6dcf-4739-ad46-f2be060ac1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:02 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:02 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Volume volume-e72e060e-45c2-466a-a79a-a7fd3508148b (e72e060e-45c2-466a-a79a-a7fd3508148b): created successfully Sep 25 17:22:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a1ef73e-6dcf-4739-ad46-f2be060ac1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Flow 'volume_create_manager' (1e0438ff-9b04-4bf2-86cb-0e7ccbee269d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:22:02 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-1e7e80cc-e6d6-47c0-8e53-63d51e0141aa tempest-ProjectReaderTests-930602704 None] Created volume successfully. Sep 25 17:22:02 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0 1073741824" returned: 0 in 0.521s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:02 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0 Sep 25 17:22:02 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:03 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0" returned: 0 in 0.281s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:22:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52fc1fb7-979f-4c98-9e72-f5518970bdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34542998-180f-45ad-9870-15fa8469b1d0', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486cf4c7-181d-418b-b323-1acda6bd413f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:03 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Volume volume-34542998-180f-45ad-9870-15fa8469b1d0 (34542998-180f-45ad-9870-15fa8469b1d0): created successfully Sep 25 17:22:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486cf4c7-181d-418b-b323-1acda6bd413f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Flow 'volume_create_manager' (d6ed3f7d-8a98-4196-b036-13b4cf24e9e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:22:03 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-79ca7825-f8d4-496a-a310-489845f783ce tempest-VolumesDeleteCascade-1966557968 None] Created volume successfully. Sep 25 17:22:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-832b2e0a-5f76-4bc6-915c-1abf754a015c tempest-ProjectReaderTests-930602704 None] Acquiring lock "cinder-e72e060e-45c2-466a-a79a-a7fd3508148b-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-832b2e0a-5f76-4bc6-915c-1abf754a015c tempest-ProjectReaderTests-930602704 None] Lock "cinder-e72e060e-45c2-466a-a79a-a7fd3508148b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-832b2e0a-5f76-4bc6-915c-1abf754a015c tempest-ProjectReaderTests-930602704 None] Acquiring lock "cinder-quobyte-e72e060e-45c2-466a-a79a-a7fd3508148b" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-832b2e0a-5f76-4bc6-915c-1abf754a015c tempest-ProjectReaderTests-930602704 None] Lock "cinder-quobyte-e72e060e-45c2-466a-a79a-a7fd3508148b" acquired by "delete_volume" :: waited 0.016s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:03 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a363135-a554-41cc-86e8-f9f561581d21]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:22:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-832b2e0a-5f76-4bc6-915c-1abf754a015c tempest-ProjectReaderTests-930602704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e72e060e-45c2-466a-a79a-a7fd3508148b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:03 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e72e060e-45c2-466a-a79a-a7fd3508148b Sep 25 17:22:03 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:03 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-832b2e0a-5f76-4bc6-915c-1abf754a015c tempest-ProjectReaderTests-930602704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e72e060e-45c2-466a-a79a-a7fd3508148b" returned: 0 in 0.500s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-832b2e0a-5f76-4bc6-915c-1abf754a015c tempest-ProjectReaderTests-930602704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e72e060e-45c2-466a-a79a-a7fd3508148b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:04 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e72e060e-45c2-466a-a79a-a7fd3508148b Sep 25 17:22:04 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bf3c35fc-9a63-4f97-8af8-2fefc1e43b14 tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bf3c35fc-9a63-4f97-8af8-2fefc1e43b14 tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:04 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-bf3c35fc-9a63-4f97-8af8-2fefc1e43b14 tempest-VolumesDeleteCascade-1966557968 None] Creating offline snapshot 425724bd-b210-4cc0-ab81-537fe414298b of volume 34542998-180f-45ad-9870-15fa8469b1d0 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:22:04 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e95625-6467-4407-8267-f3f50190f0b2]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:22:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bf3c35fc-9a63-4f97-8af8-2fefc1e43b14 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:04 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-832b2e0a-5f76-4bc6-915c-1abf754a015c tempest-ProjectReaderTests-930602704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e72e060e-45c2-466a-a79a-a7fd3508148b" returned: 0 in 0.350s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:04 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0 Sep 25 17:22:04 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-832b2e0a-5f76-4bc6-915c-1abf754a015c tempest-ProjectReaderTests-930602704 None] Lock "cinder-quobyte-e72e060e-45c2-466a-a79a-a7fd3508148b" released by "delete_volume" :: held 0.905s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:04 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-832b2e0a-5f76-4bc6-915c-1abf754a015c tempest-ProjectReaderTests-930602704 None] Created reservations ['e73eb521-19b4-44d2-8a36-4ab95c5d354b', 'a04184a8-9bf6-4f24-b059-8444714281e4', '4bb594cf-1125-4018-8b13-80208215fb85', 'd9569760-21f4-4146-8a05-468e64d46098'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:22:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-832b2e0a-5f76-4bc6-915c-1abf754a015c tempest-ProjectReaderTests-930602704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-832b2e0a-5f76-4bc6-915c-1abf754a015c tempest-ProjectReaderTests-930602704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:04 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-832b2e0a-5f76-4bc6-915c-1abf754a015c tempest-ProjectReaderTests-930602704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:22:04 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-832b2e0a-5f76-4bc6-915c-1abf754a015c tempest-ProjectReaderTests-930602704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:22:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-832b2e0a-5f76-4bc6-915c-1abf754a015c tempest-ProjectReaderTests-930602704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-832b2e0a-5f76-4bc6-915c-1abf754a015c tempest-ProjectReaderTests-930602704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:04 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:22:04 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:04 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bf3c35fc-9a63-4f97-8af8-2fefc1e43b14 tempest-VolumesDeleteCascade-1966557968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0" returned: 0 in 0.484s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bf3c35fc-9a63-4f97-8af8-2fefc1e43b14 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:04 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b 1G Sep 25 17:22:04 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:04 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-832b2e0a-5f76-4bc6-915c-1abf754a015c tempest-ProjectReaderTests-930602704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.316s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:04 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-832b2e0a-5f76-4bc6-915c-1abf754a015c tempest-ProjectReaderTests-930602704 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:22:04 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-832b2e0a-5f76-4bc6-915c-1abf754a015c tempest-ProjectReaderTests-930602704 None] Deleted volume successfully. Sep 25 17:22:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-832b2e0a-5f76-4bc6-915c-1abf754a015c tempest-ProjectReaderTests-930602704 None] Lock "cinder-e72e060e-45c2-466a-a79a-a7fd3508148b-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:05 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:22:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Flow 'volume_create_manager' (fe138b2b-b502-4c88-b595-3b232abc5a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:22:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a97a1f-b19c-438f-a7c3-d7f58f4080bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:05 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a97a1f-b19c-438f-a7c3-d7f58f4080bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1084941849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7324bf6f-8fa3-45d3-a32a-b148f2b06fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efdd7b6949164ebeaca87c32238daa0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:05Z,use_quota=True,user_id='eaeb2c1639e1498cb810a033eb0e99b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3356ab-4f74-4dc9-9fa8-d46c01bf6945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3356ab-4f74-4dc9-9fa8-d46c01bf6945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3478e205-8dc0-455f-b417-cb84a8172822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3478e205-8dc0-455f-b417-cb84a8172822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7324bf6f-8fa3-45d3-a32a-b148f2b06fe5', 'volume_name': 'volume-7324bf6f-8fa3-45d3-a32a-b148f2b06fe5', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13eea418-9486-4839-91c7-9f9cde676ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13eea418-9486-4839-91c7-9f9cde676ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c877c1c-c9ca-49d1-8ec2-637c1d0e5529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:05 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Volume 7324bf6f-8fa3-45d3-a32a-b148f2b06fe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7324bf6f-8fa3-45d3-a32a-b148f2b06fe5', 'volume_size': 1} Sep 25 17:22:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bf3c35fc-9a63-4f97-8af8-2fefc1e43b14 tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b 1G" returned: 0 in 0.558s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bf3c35fc-9a63-4f97-8af8-2fefc1e43b14 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34542998-180f-45ad-9870-15fa8469b1d0 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:05 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34542998-180f-45ad-9870-15fa8469b1d0 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b Sep 25 17:22:05 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:05 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bf3c35fc-9a63-4f97-8af8-2fefc1e43b14 tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34542998-180f-45ad-9870-15fa8469b1d0 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b" returned: 0 in 0.301s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:05 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-bf3c35fc-9a63-4f97-8af8-2fefc1e43b14 tempest-VolumesDeleteCascade-1966557968 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b is being set with open permissions: ugo+rw Sep 25 17:22:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bf3c35fc-9a63-4f97-8af8-2fefc1e43b14 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:05 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b Sep 25 17:22:05 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:05 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bf3c35fc-9a63-4f97-8af8-2fefc1e43b14 tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b" returned: 0 in 0.290s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bf3c35fc-9a63-4f97-8af8-2fefc1e43b14 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:05 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.info Sep 25 17:22:05 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:06 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bf3c35fc-9a63-4f97-8af8-2fefc1e43b14 tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.info" returned: 0 in 0.284s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:06 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-bf3c35fc-9a63-4f97-8af8-2fefc1e43b14 tempest-VolumesDeleteCascade-1966557968 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.info is being set with open permissions: ugo+rw Sep 25 17:22:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bf3c35fc-9a63-4f97-8af8-2fefc1e43b14 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:06 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.info Sep 25 17:22:06 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:06 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bf3c35fc-9a63-4f97-8af8-2fefc1e43b14 tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.info" returned: 0 in 0.287s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bf3c35fc-9a63-4f97-8af8-2fefc1e43b14 tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.308s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.228s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1084941849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7324bf6f-8fa3-45d3-a32a-b148f2b06fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efdd7b6949164ebeaca87c32238daa0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:05Z,use_quota=True,user_id='eaeb2c1639e1498cb810a033eb0e99b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:22:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Creating volume 7324bf6f-8fa3-45d3-a32a-b148f2b06fe5 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:22:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:22:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:22:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:22:06 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:22:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7324bf6f-8fa3-45d3-a32a-b148f2b06fe5 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:06 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7324bf6f-8fa3-45d3-a32a-b148f2b06fe5 1073741824 Sep 25 17:22:06 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:06 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-bf3c35fc-9a63-4f97-8af8-2fefc1e43b14 tempest-VolumesDeleteCascade-1966557968 None] Create snapshot completed successfully Sep 25 17:22:06 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7324bf6f-8fa3-45d3-a32a-b148f2b06fe5 1073741824" returned: 0 in 0.459s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:06 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:UPDATE=89,cinder:SELECT=79,cinder:INSERT=29,cinder:DELETE=7 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:22:06 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=86,cinder:INSERT=21,cinder:UPDATE=91,cinder:DELETE=11 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:22:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7324bf6f-8fa3-45d3-a32a-b148f2b06fe5 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:07 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7324bf6f-8fa3-45d3-a32a-b148f2b06fe5 Sep 25 17:22:07 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:07 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7324bf6f-8fa3-45d3-a32a-b148f2b06fe5" returned: 0 in 0.267s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:22:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c877c1c-c9ca-49d1-8ec2-637c1d0e5529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7324bf6f-8fa3-45d3-a32a-b148f2b06fe5', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a36f33-8200-44be-bd87-de40894961a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:07 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Volume volume-7324bf6f-8fa3-45d3-a32a-b148f2b06fe5 (7324bf6f-8fa3-45d3-a32a-b148f2b06fe5): created successfully Sep 25 17:22:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a36f33-8200-44be-bd87-de40894961a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Flow 'volume_create_manager' (fe138b2b-b502-4c88-b595-3b232abc5a34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:22:07 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-33a60b8b-fa60-4fcb-a955-97169ea9b0d3 tempest-ProjectReaderTests-930602704 None] Created volume successfully. Sep 25 17:22:07 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:22:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Flow 'volume_create_manager' (59164c10-805a-40cc-babe-0e17da7b514c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:22:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c8407a-cf97-43ff-9f65-9060156090a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c8407a-cf97-43ff-9f65-9060156090a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1969818416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1304dd8-dbef-4689-9e0f-3eca2d8cc4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba469741d424f5296bbce28b534135d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=425724bd-b210-4cc0-ab81-537fe414298b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:08Z,use_quota=True,user_id='de0089eb89544dfb8e07abfab54e6de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01395d1f-a05f-45ef-91a8-e6b3f0f0e756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01395d1f-a05f-45ef-91a8-e6b3f0f0e756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94999bfe-a69a-456f-aa89-4dd92f43d700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94999bfe-a69a-456f-aa89-4dd92f43d700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a1304dd8-dbef-4689-9e0f-3eca2d8cc4db', 'volume_name': 'volume-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db', 'volume_size': 1, 'snapshot_id': '425724bd-b210-4cc0-ab81-537fe414298b'}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf3342c-8259-4aaf-8739-ca3d7a9b6332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf3342c-8259-4aaf-8739-ca3d7a9b6332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cebbc58f-2948-48c4-912c-f064245a187b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:07 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Volume a1304dd8-dbef-4689-9e0f-3eca2d8cc4db: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db', 'volume_size': 1, 'snapshot_id': '425724bd-b210-4cc0-ab81-537fe414298b'} Sep 25 17:22:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "cinder-quobyte-425724bd-b210-4cc0-ab81-537fe414298b-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db" by "_create_volume_from_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-quobyte-425724bd-b210-4cc0-ab81-537fe414298b-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Creating volume a1304dd8-dbef-4689-9e0f-3eca2d8cc4db from snapshot 425724bd-b210-4cc0-ab81-537fe414298b {{(pid=87211) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "cinder-quobyte-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db" by "_copy_volume_from_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-quobyte-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] snapshot: 425724bd-b210-4cc0-ab81-537fe414298b, volume: a1304dd8-dbef-4689-9e0f-3eca2d8cc4db, {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0575f04-6b0b-4f26-854c-4c2cf78ba7c5]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:08 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b Sep 25 17:22:08 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e5ea7358-12bc-4474-bf82-6eebca5dfe82 tempest-ProjectReaderTests-930602704 None] Acquiring lock "cinder-7324bf6f-8fa3-45d3-a32a-b148f2b06fe5-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e5ea7358-12bc-4474-bf82-6eebca5dfe82 tempest-ProjectReaderTests-930602704 None] Lock "cinder-7324bf6f-8fa3-45d3-a32a-b148f2b06fe5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e5ea7358-12bc-4474-bf82-6eebca5dfe82 tempest-ProjectReaderTests-930602704 None] Acquiring lock "cinder-quobyte-7324bf6f-8fa3-45d3-a32a-b148f2b06fe5" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e5ea7358-12bc-4474-bf82-6eebca5dfe82 tempest-ProjectReaderTests-930602704 None] Lock "cinder-quobyte-7324bf6f-8fa3-45d3-a32a-b148f2b06fe5" acquired by "delete_volume" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2aa2216-57ed-4980-8b18-1809fe23c261]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e5ea7358-12bc-4474-bf82-6eebca5dfe82 tempest-ProjectReaderTests-930602704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7324bf6f-8fa3-45d3-a32a-b148f2b06fe5 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:08 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b" returned: 0 in 0.436s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34542998-180f-45ad-9870-15fa8469b1d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[2032ab16-cffe-46d3-83e9-bd93efb40b67]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:08 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7324bf6f-8fa3-45d3-a32a-b148f2b06fe5 Sep 25 17:22:08 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:08 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0 Sep 25 17:22:08 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:08 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e5ea7358-12bc-4474-bf82-6eebca5dfe82 tempest-ProjectReaderTests-930602704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7324bf6f-8fa3-45d3-a32a-b148f2b06fe5" returned: 0 in 0.438s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e5ea7358-12bc-4474-bf82-6eebca5dfe82 tempest-ProjectReaderTests-930602704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7324bf6f-8fa3-45d3-a32a-b148f2b06fe5 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:08 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0" returned: 0 in 0.400s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] will copy from snapshot at /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0 {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Creating direct copy from snapshot {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG cinder.utils [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Path /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db not found in is_blk_device check {{(pid=87211) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:22:08 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7324bf6f-8fa3-45d3-a32a-b148f2b06fe5 Sep 25 17:22:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:08 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:08 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db Sep 25 17:22:08 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:09 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e5ea7358-12bc-4474-bf82-6eebca5dfe82 tempest-ProjectReaderTests-930602704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7324bf6f-8fa3-45d3-a32a-b148f2b06fe5" returned: 0 in 0.256s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:09 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e5ea7358-12bc-4474-bf82-6eebca5dfe82 tempest-ProjectReaderTests-930602704 None] Lock "cinder-quobyte-7324bf6f-8fa3-45d3-a32a-b148f2b06fe5" released by "delete_volume" :: held 0.745s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:09 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-e5ea7358-12bc-4474-bf82-6eebca5dfe82 tempest-ProjectReaderTests-930602704 None] Created reservations ['46b254db-706e-4131-9fe4-a322b866c6a0', '3c732baf-d0e5-462f-ad87-8dd3eae76942', '613fa2e1-1c35-427a-b27b-f7f283a79cac', 'ab684c1a-3632-4552-80bf-3daea065f860'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:22:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e5ea7358-12bc-4474-bf82-6eebca5dfe82 tempest-ProjectReaderTests-930602704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e5ea7358-12bc-4474-bf82-6eebca5dfe82 tempest-ProjectReaderTests-930602704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:09 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e5ea7358-12bc-4474-bf82-6eebca5dfe82 tempest-ProjectReaderTests-930602704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:22:09 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e5ea7358-12bc-4474-bf82-6eebca5dfe82 tempest-ProjectReaderTests-930602704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:22:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e5ea7358-12bc-4474-bf82-6eebca5dfe82 tempest-ProjectReaderTests-930602704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e5ea7358-12bc-4474-bf82-6eebca5dfe82 tempest-ProjectReaderTests-930602704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:09 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:22:09 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:09 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e5ea7358-12bc-4474-bf82-6eebca5dfe82 tempest-ProjectReaderTests-930602704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.313s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:09 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-e5ea7358-12bc-4474-bf82-6eebca5dfe82 tempest-ProjectReaderTests-930602704 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:22:09 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-e5ea7358-12bc-4474-bf82-6eebca5dfe82 tempest-ProjectReaderTests-930602704 None] Deleted volume successfully. Sep 25 17:22:09 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e5ea7358-12bc-4474-bf82-6eebca5dfe82 tempest-ProjectReaderTests-930602704 None] Lock "cinder-7324bf6f-8fa3-45d3-a32a-b148f2b06fe5-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:10 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:22:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Flow 'volume_create_manager' (9212d6b8-62d1-4149-8088-a2fc49d1258f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:22:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af01b57-7731-43ac-a703-4db4c3d5472d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af01b57-7731-43ac-a703-4db4c3d5472d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1283995473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9703995-b480-421a-9038-07ede01e9641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efdd7b6949164ebeaca87c32238daa0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:10Z,use_quota=True,user_id='eaeb2c1639e1498cb810a033eb0e99b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed6bbf08-a57d-4400-abad-e76358ebcb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed6bbf08-a57d-4400-abad-e76358ebcb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ebcab5-cd69-4f5d-99cd-d9f59b3fe9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ebcab5-cd69-4f5d-99cd-d9f59b3fe9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9703995-b480-421a-9038-07ede01e9641', 'volume_name': 'volume-b9703995-b480-421a-9038-07ede01e9641', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77b83cb-cad9-4b3a-95d5-ce549a451574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77b83cb-cad9-4b3a-95d5-ce549a451574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63440f70-7e1b-498a-b2f0-0d5a924a2de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:10 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Volume b9703995-b480-421a-9038-07ede01e9641: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9703995-b480-421a-9038-07ede01e9641', 'volume_size': 1} Sep 25 17:22:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:15 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db" returned: 0 in 6.628s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:15 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Image conversion details: src /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0, size 1024.00 MB, duration 6.63 sec, destination /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:22:15 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Converted 1024.00 MB image at 154.47 MB/s Sep 25 17:22:15 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db is being set with open permissions: ugo+rw Sep 25 17:22:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:15 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db Sep 25 17:22:15 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:15 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db" returned: 0 in 0.249s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:15 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-quobyte-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db" released by "_copy_volume_from_snapshot" :: held 7.800s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:15 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-quobyte-425724bd-b210-4cc0-ab81-537fe414298b-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db" released by "_create_volume_from_snapshot" :: held 7.876s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.894s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.343s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1283995473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9703995-b480-421a-9038-07ede01e9641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efdd7b6949164ebeaca87c32238daa0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:10Z,use_quota=True,user_id='eaeb2c1639e1498cb810a033eb0e99b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:22:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Creating volume b9703995-b480-421a-9038-07ede01e9641 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:22:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:22:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:22:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:22:15 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:22:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9703995-b480-421a-9038-07ede01e9641 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:15 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9703995-b480-421a-9038-07ede01e9641 1073741824 Sep 25 17:22:15 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cebbc58f-2948-48c4-912c-f064245a187b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db', 'volume_size': 1, 'snapshot_id': '425724bd-b210-4cc0-ab81-537fe414298b'}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4028a4f9-8556-44a0-b9a6-a56f5d9e7e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:15 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Volume volume-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db (a1304dd8-dbef-4689-9e0f-3eca2d8cc4db): created successfully Sep 25 17:22:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4028a4f9-8556-44a0-b9a6-a56f5d9e7e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Flow 'volume_create_manager' (59164c10-805a-40cc-babe-0e17da7b514c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:22:16 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-20192371-a02a-4d4e-8e26-cf923dafcf7a tempest-VolumesDeleteCascade-1966557968 None] Created volume successfully. Sep 25 17:22:16 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9703995-b480-421a-9038-07ede01e9641 1073741824" returned: 0 in 0.454s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9703995-b480-421a-9038-07ede01e9641 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:16 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9703995-b480-421a-9038-07ede01e9641 Sep 25 17:22:16 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:16 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9703995-b480-421a-9038-07ede01e9641" returned: 0 in 0.261s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:22:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63440f70-7e1b-498a-b2f0-0d5a924a2de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9703995-b480-421a-9038-07ede01e9641', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d57baef-b83e-437a-aa88-f363356ba148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:16 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Volume volume-b9703995-b480-421a-9038-07ede01e9641 (b9703995-b480-421a-9038-07ede01e9641): created successfully Sep 25 17:22:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d57baef-b83e-437a-aa88-f363356ba148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Flow 'volume_create_manager' (9212d6b8-62d1-4149-8088-a2fc49d1258f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:22:16 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-4b8e0f3a-9310-472e-8c51-3dcf2bd6472d tempest-ProjectReaderTests-930602704 None] Created volume successfully. Sep 25 17:22:16 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "cinder-34542998-180f-45ad-9870-15fa8469b1d0-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:16 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-34542998-180f-45ad-9870-15fa8469b1d0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Performing cascade delete. {{(pid=87211) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 17:22:16 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "cinder-425724bd-b210-4cc0-ab81-537fe414298b-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:16 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-425724bd-b210-4cc0-ab81-537fe414298b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:16 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "cinder-quobyte-34542998-180f-45ad-9870-15fa8469b1d0" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:16 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-quobyte-34542998-180f-45ad-9870-15fa8469b1d0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:16 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "cinder-quobyte-425724bd-b210-4cc0-ab81-537fe414298b" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:16 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-quobyte-425724bd-b210-4cc0-ab81-537fe414298b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Deleting offline snapshot 425724bd-b210-4cc0-ab81-537fe414298b of volume 34542998-180f-45ad-9870-15fa8469b1d0 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:22:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] snapshot_file for this snap is: volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:22:17 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e26f51-b864-4fb4-9c5f-b993985cfb15]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:22:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-11150d95-2e0c-4432-977e-c77058e200c0 tempest-ProjectReaderTests-930602704 None] Acquiring lock "cinder-b9703995-b480-421a-9038-07ede01e9641-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-11150d95-2e0c-4432-977e-c77058e200c0 tempest-ProjectReaderTests-930602704 None] Lock "cinder-b9703995-b480-421a-9038-07ede01e9641-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-11150d95-2e0c-4432-977e-c77058e200c0 tempest-ProjectReaderTests-930602704 None] Acquiring lock "cinder-quobyte-b9703995-b480-421a-9038-07ede01e9641" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-11150d95-2e0c-4432-977e-c77058e200c0 tempest-ProjectReaderTests-930602704 None] Lock "cinder-quobyte-b9703995-b480-421a-9038-07ede01e9641" acquired by "delete_volume" :: waited 0.026s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:17 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b Sep 25 17:22:17 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:17 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[678731bb-4a20-40a8-a0a5-b25aa597d323]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:22:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-11150d95-2e0c-4432-977e-c77058e200c0 tempest-ProjectReaderTests-930602704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9703995-b480-421a-9038-07ede01e9641 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:17 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9703995-b480-421a-9038-07ede01e9641 Sep 25 17:22:17 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:17 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b" returned: 0 in 0.420s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34542998-180f-45ad-9870-15fa8469b1d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:22:17 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dd71f5-d22f-4063-b0db-3877e4332abd]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:22:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:17 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-11150d95-2e0c-4432-977e-c77058e200c0 tempest-ProjectReaderTests-930602704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9703995-b480-421a-9038-07ede01e9641" returned: 0 in 0.420s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-11150d95-2e0c-4432-977e-c77058e200c0 tempest-ProjectReaderTests-930602704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9703995-b480-421a-9038-07ede01e9641 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:17 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9703995-b480-421a-9038-07ede01e9641 Sep 25 17:22:17 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:17 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0 Sep 25 17:22:17 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:17 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-11150d95-2e0c-4432-977e-c77058e200c0 tempest-ProjectReaderTests-930602704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b9703995-b480-421a-9038-07ede01e9641" returned: 0 in 0.271s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-11150d95-2e0c-4432-977e-c77058e200c0 tempest-ProjectReaderTests-930602704 None] Lock "cinder-quobyte-b9703995-b480-421a-9038-07ede01e9641" released by "delete_volume" :: held 0.762s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:17 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-11150d95-2e0c-4432-977e-c77058e200c0 tempest-ProjectReaderTests-930602704 None] Created reservations ['8ec80a1e-2e2d-4abd-b16b-111221002752', '5a30b127-7fb7-4594-9a4d-7fb10c79d623', '736e23d4-0dfe-47c6-a998-a29aa7284786', '39394ea9-f5f7-4437-88bb-e7207ec6ef52'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:22:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-11150d95-2e0c-4432-977e-c77058e200c0 tempest-ProjectReaderTests-930602704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-11150d95-2e0c-4432-977e-c77058e200c0 tempest-ProjectReaderTests-930602704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:18 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-11150d95-2e0c-4432-977e-c77058e200c0 tempest-ProjectReaderTests-930602704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:22:18 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-11150d95-2e0c-4432-977e-c77058e200c0 tempest-ProjectReaderTests-930602704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:22:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-11150d95-2e0c-4432-977e-c77058e200c0 tempest-ProjectReaderTests-930602704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-11150d95-2e0c-4432-977e-c77058e200c0 tempest-ProjectReaderTests-930602704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:18 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:22:18 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:18 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0" returned: 0 in 0.639s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:18 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b Sep 25 17:22:18 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:18 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-11150d95-2e0c-4432-977e-c77058e200c0 tempest-ProjectReaderTests-930602704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.375s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:18 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-11150d95-2e0c-4432-977e-c77058e200c0 tempest-ProjectReaderTests-930602704 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:22:18 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-11150d95-2e0c-4432-977e-c77058e200c0 tempest-ProjectReaderTests-930602704 None] Deleted volume successfully. Sep 25 17:22:18 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-11150d95-2e0c-4432-977e-c77058e200c0 tempest-ProjectReaderTests-930602704 None] Lock "cinder-b9703995-b480-421a-9038-07ede01e9641-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:18 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b" returned: 0 in 0.523s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:18 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b Sep 25 17:22:18 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:18 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0.425724bd-b210-4cc0-ab81-537fe414298b" returned: 0 in 0.296s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-quobyte-425724bd-b210-4cc0-ab81-537fe414298b" released by "_delete_snapshot" :: held 2.052s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-quobyte-34542998-180f-45ad-9870-15fa8469b1d0" released by "delete_snapshot" :: held 2.079s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:19 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Created reservations ['0d2b3779-f6ef-4cf0-8436-3d1fd1c18721', '57a20fe3-cea5-45db-b46a-c679ff93f936', '5422f8b8-d9b3-4b2d-b3b8-16ef7eefc6e0', 'ea5f31cc-4c4c-4c80-aae3-8de8dcfab190'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:22:19 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Delete snapshot completed successfully. Sep 25 17:22:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-425724bd-b210-4cc0-ab81-537fe414298b-delete_snapshot" released by "delete_snapshot" :: held 2.296s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Snapshots deleted, issuing volume delete {{(pid=87211) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 17:22:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "cinder-quobyte-34542998-180f-45ad-9870-15fa8469b1d0" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-quobyte-34542998-180f-45ad-9870-15fa8469b1d0" acquired by "delete_volume" :: waited 0.021s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-a322bf06-2ddf-4684-9c5f-454511acc5d2 req-344420fc-613d-430e-95e1-b59b393f6451 tempest-TestStampPattern-2048838673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-a322bf06-2ddf-4684-9c5f-454511acc5d2 req-344420fc-613d-430e-95e1-b59b393f6451 tempest-TestStampPattern-2048838673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:19 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[7841b224-1051-483b-9468-50c018e8a475]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:22:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [req-a322bf06-2ddf-4684-9c5f-454511acc5d2 req-344420fc-613d-430e-95e1-b59b393f6451 tempest-TestStampPattern-2048838673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-a322bf06-2ddf-4684-9c5f-454511acc5d2 req-344420fc-613d-430e-95e1-b59b393f6451 tempest-TestStampPattern-2048838673 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081', 'name': 'volume-94856d40-2618-47fc-a70d-0d52504e760d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb942e9d-921d-48b3-b1f4-40b3399ca8ae', 'enforce_multipath': True} {{(pid=87211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:22:19 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-a322bf06-2ddf-4684-9c5f-454511acc5d2 req-344420fc-613d-430e-95e1-b59b393f6451 tempest-TestStampPattern-2048838673 None] attachment_update completed successfully. Sep 25 17:22:19 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0 Sep 25 17:22:19 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:19 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0" returned: 0 in 0.507s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:19 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0 Sep 25 17:22:19 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:20 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-34542998-180f-45ad-9870-15fa8469b1d0" returned: 0 in 0.361s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:20 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-quobyte-34542998-180f-45ad-9870-15fa8469b1d0" released by "delete_volume" :: held 0.946s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:20 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Created reservations ['5781e9fe-3c11-4c8d-8bc3-34dcef490ecc', 'd98feb77-e8d6-481b-816c-ba10d04b2fbf', 'bc170417-7990-443b-9946-d21116f659d1', 'c3946ef9-147f-48d1-9bf8-07460d89fc42'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:22:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:20 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:22:20 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:22:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:20 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:22:20 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:20 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.333s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:20 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:22:20 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Deleted volume successfully. Sep 25 17:22:20 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-3a2e9d5c-23d6-44c3-9fa6-6a5b71d914b9 tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-34542998-180f-45ad-9870-15fa8469b1d0-delete_volume" released by "delete_volume" :: held 3.876s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e4e65228-6c0f-401d-9393-54f252a41145 tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "cinder-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e4e65228-6c0f-401d-9393-54f252a41145 tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e4e65228-6c0f-401d-9393-54f252a41145 tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "cinder-quobyte-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e4e65228-6c0f-401d-9393-54f252a41145 tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-quobyte-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db" acquired by "delete_volume" :: waited 0.015s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:21 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[49132cc4-2685-429a-a41b-17da529caba5]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:22:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e4e65228-6c0f-401d-9393-54f252a41145 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:21 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db Sep 25 17:22:21 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:21 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e4e65228-6c0f-401d-9393-54f252a41145 tempest-VolumesDeleteCascade-1966557968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db" returned: 0 in 0.378s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e4e65228-6c0f-401d-9393-54f252a41145 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:21 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db Sep 25 17:22:21 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:22 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e4e65228-6c0f-401d-9393-54f252a41145 tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db" returned: 0 in 0.260s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e4e65228-6c0f-401d-9393-54f252a41145 tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-quobyte-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db" released by "delete_volume" :: held 0.681s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:22 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-e4e65228-6c0f-401d-9393-54f252a41145 tempest-VolumesDeleteCascade-1966557968 None] Created reservations ['9a00d594-20ee-4d33-a1ec-dee68b77ce9f', 'db8bbf2f-27a0-4b73-ba7d-5f005d412f55', 'ff640144-9a51-46ae-83d2-0d437423ffb3', '63d86000-ec40-4207-9747-6d28fbd234e3'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:22:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e4e65228-6c0f-401d-9393-54f252a41145 tempest-VolumesDeleteCascade-1966557968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e4e65228-6c0f-401d-9393-54f252a41145 tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e4e65228-6c0f-401d-9393-54f252a41145 tempest-VolumesDeleteCascade-1966557968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:22:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e4e65228-6c0f-401d-9393-54f252a41145 tempest-VolumesDeleteCascade-1966557968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:22:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e4e65228-6c0f-401d-9393-54f252a41145 tempest-VolumesDeleteCascade-1966557968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e4e65228-6c0f-401d-9393-54f252a41145 tempest-VolumesDeleteCascade-1966557968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:22 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:22:22 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:22 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e4e65228-6c0f-401d-9393-54f252a41145 tempest-VolumesDeleteCascade-1966557968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.275s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:22 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-e4e65228-6c0f-401d-9393-54f252a41145 tempest-VolumesDeleteCascade-1966557968 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:22:22 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-e4e65228-6c0f-401d-9393-54f252a41145 tempest-VolumesDeleteCascade-1966557968 None] Deleted volume successfully. Sep 25 17:22:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e4e65228-6c0f-401d-9393-54f252a41145 tempest-VolumesDeleteCascade-1966557968 None] Lock "cinder-a1304dd8-dbef-4689-9e0f-3eca2d8cc4db-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:22 devstack cinder-volume[87211]: INFO cinder.volume.manager [req-1d74aaab-e5f0-4ee2-88d1-dbd7483a052f req-9c55693a-33f2-49a7-a7e8-df7a7637caef tempest-TestStampPattern-2048838673 None] Terminate volume connection completed successfully. Sep 25 17:22:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [req-1d74aaab-e5f0-4ee2-88d1-dbd7483a052f req-9c55693a-33f2-49a7-a7e8-df7a7637caef tempest-TestStampPattern-2048838673 None] Deleting attachment fb942e9d-921d-48b3-b1f4-40b3399ca8ae. {{(pid=87211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Flow 'volume_create_manager' (31d532b5-e4d1-432b-a5ad-6dd46e874d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c253d0-e8eb-4d8c-a54d-4e4bd695d501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c253d0-e8eb-4d8c-a54d-4e4bd695d501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-512198509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0aceadb-7017-4eae-80e4-2b88c980a0ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd4a6843da34285bcf0dcecb3beb2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:27Z,use_quota=True,user_id='0ff0a70474954f16b607460e63703f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa74ee09-e8f0-4bf6-94b2-6590e91c6440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa74ee09-e8f0-4bf6-94b2-6590e91c6440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85de744-e510-411f-abec-1ba05296cd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85de744-e510-411f-abec-1ba05296cd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0aceadb-7017-4eae-80e4-2b88c980a0ad', 'volume_name': 'volume-d0aceadb-7017-4eae-80e4-2b88c980a0ad', 'volume_size': 2}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7515ca-6291-4d62-9fe9-185c4e3eb326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7515ca-6291-4d62-9fe9-185c4e3eb326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c7c972-5cfc-443e-b003-52b2641ff947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:27 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Volume d0aceadb-7017-4eae-80e4-2b88c980a0ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0aceadb-7017-4eae-80e4-2b88c980a0ad', 'volume_size': 2} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-512198509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0aceadb-7017-4eae-80e4-2b88c980a0ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd4a6843da34285bcf0dcecb3beb2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:27Z,use_quota=True,user_id='0ff0a70474954f16b607460e63703f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Creating volume d0aceadb-7017-4eae-80e4-2b88c980a0ad {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:22:27 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d0aceadb-7017-4eae-80e4-2b88c980a0ad 2147483648 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-309e8e6c-2c48-4aa4-82a6-37762c60d284 tempest-TestStampPattern-2048838673 None] Acquiring lock "cinder-94856d40-2618-47fc-a70d-0d52504e760d-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:27 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d0aceadb-7017-4eae-80e4-2b88c980a0ad 2147483648 Sep 25 17:22:27 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-309e8e6c-2c48-4aa4-82a6-37762c60d284 tempest-TestStampPattern-2048838673 None] Lock "cinder-94856d40-2618-47fc-a70d-0d52504e760d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-309e8e6c-2c48-4aa4-82a6-37762c60d284 tempest-TestStampPattern-2048838673 None] Acquiring lock "cinder-quobyte-94856d40-2618-47fc-a70d-0d52504e760d" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-309e8e6c-2c48-4aa4-82a6-37762c60d284 tempest-TestStampPattern-2048838673 None] Lock "cinder-quobyte-94856d40-2618-47fc-a70d-0d52504e760d" acquired by "delete_volume" :: waited 0.017s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7da52a-9b10-492b-b32a-a5d20cafdbfd]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-309e8e6c-2c48-4aa4-82a6-37762c60d284 tempest-TestStampPattern-2048838673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-94856d40-2618-47fc-a70d-0d52504e760d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:27 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-94856d40-2618-47fc-a70d-0d52504e760d Sep 25 17:22:27 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:27 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-309e8e6c-2c48-4aa4-82a6-37762c60d284 tempest-TestStampPattern-2048838673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-94856d40-2618-47fc-a70d-0d52504e760d" returned: 0 in 0.411s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-309e8e6c-2c48-4aa4-82a6-37762c60d284 tempest-TestStampPattern-2048838673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-94856d40-2618-47fc-a70d-0d52504e760d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:27 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d0aceadb-7017-4eae-80e4-2b88c980a0ad 2147483648" returned: 0 in 0.553s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:27 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-94856d40-2618-47fc-a70d-0d52504e760d Sep 25 17:22:27 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d0aceadb-7017-4eae-80e4-2b88c980a0ad {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:27 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d0aceadb-7017-4eae-80e4-2b88c980a0ad Sep 25 17:22:27 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:27 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-309e8e6c-2c48-4aa4-82a6-37762c60d284 tempest-TestStampPattern-2048838673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-94856d40-2618-47fc-a70d-0d52504e760d" returned: 0 in 0.257s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-309e8e6c-2c48-4aa4-82a6-37762c60d284 tempest-TestStampPattern-2048838673 None] Lock "cinder-quobyte-94856d40-2618-47fc-a70d-0d52504e760d" released by "delete_volume" :: held 0.718s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-309e8e6c-2c48-4aa4-82a6-37762c60d284 tempest-TestStampPattern-2048838673 None] Created reservations ['1367033c-a8bb-4035-b42b-a9b5e60e28d8', 'e2c98d5e-a04b-4542-a63a-509ac6c8ed4b', 'e28d9827-5352-456f-a7ab-a4987b5a59db', '3085f398-8ba0-4e76-a9ec-e3c5ceb3416f'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:22:27 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d0aceadb-7017-4eae-80e4-2b88c980a0ad" returned: 0 in 0.301s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:22:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c7c972-5cfc-443e-b003-52b2641ff947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0aceadb-7017-4eae-80e4-2b88c980a0ad', 'volume_size': 2}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4797ea-e08e-43f6-870d-00789d504c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:28 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Volume volume-d0aceadb-7017-4eae-80e4-2b88c980a0ad (d0aceadb-7017-4eae-80e4-2b88c980a0ad): created successfully Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4797ea-e08e-43f6-870d-00789d504c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Flow 'volume_create_manager' (31d532b5-e4d1-432b-a5ad-6dd46e874d12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:22:28 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-6e70773e-e20e-4d01-9d1e-b2ead01fd52f tempest-VolumesCloneNegativeTest-372390740 None] Created volume successfully. Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-309e8e6c-2c48-4aa4-82a6-37762c60d284 tempest-TestStampPattern-2048838673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-309e8e6c-2c48-4aa4-82a6-37762c60d284 tempest-TestStampPattern-2048838673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-309e8e6c-2c48-4aa4-82a6-37762c60d284 tempest-TestStampPattern-2048838673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-309e8e6c-2c48-4aa4-82a6-37762c60d284 tempest-TestStampPattern-2048838673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-309e8e6c-2c48-4aa4-82a6-37762c60d284 tempest-TestStampPattern-2048838673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-309e8e6c-2c48-4aa4-82a6-37762c60d284 tempest-TestStampPattern-2048838673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:28 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:22:28 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:28 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-309e8e6c-2c48-4aa4-82a6-37762c60d284 tempest-TestStampPattern-2048838673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.279s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-309e8e6c-2c48-4aa4-82a6-37762c60d284 tempest-TestStampPattern-2048838673 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:22:28 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-309e8e6c-2c48-4aa4-82a6-37762c60d284 tempest-TestStampPattern-2048838673 None] Deleted volume successfully. Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-309e8e6c-2c48-4aa4-82a6-37762c60d284 tempest-TestStampPattern-2048838673 None] Lock "cinder-94856d40-2618-47fc-a70d-0d52504e760d-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c50d31f0-70e7-4c7f-8d9f-a36135fdd249 tempest-TestStampPattern-2048838673 None] Acquiring lock "cinder-6903a710-1d0f-4560-a527-2684461e1b6b-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c50d31f0-70e7-4c7f-8d9f-a36135fdd249 tempest-TestStampPattern-2048838673 None] Lock "cinder-6903a710-1d0f-4560-a527-2684461e1b6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c50d31f0-70e7-4c7f-8d9f-a36135fdd249 tempest-TestStampPattern-2048838673 None] Acquiring lock "cinder-quobyte-1b27aa9e-bd71-46f9-b605-6e9f84af9503" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c50d31f0-70e7-4c7f-8d9f-a36135fdd249 tempest-TestStampPattern-2048838673 None] Lock "cinder-quobyte-1b27aa9e-bd71-46f9-b605-6e9f84af9503" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c50d31f0-70e7-4c7f-8d9f-a36135fdd249 tempest-TestStampPattern-2048838673 None] Acquiring lock "cinder-quobyte-6903a710-1d0f-4560-a527-2684461e1b6b" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c50d31f0-70e7-4c7f-8d9f-a36135fdd249 tempest-TestStampPattern-2048838673 None] Lock "cinder-quobyte-6903a710-1d0f-4560-a527-2684461e1b6b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-c50d31f0-70e7-4c7f-8d9f-a36135fdd249 tempest-TestStampPattern-2048838673 None] Deleting offline snapshot 6903a710-1d0f-4560-a527-2684461e1b6b of volume 1b27aa9e-bd71-46f9-b605-6e9f84af9503 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-c50d31f0-70e7-4c7f-8d9f-a36135fdd249 tempest-TestStampPattern-2048838673 None] snapshot_file for this snap is: volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[03122ce7-c0b0-45cc-991f-39a36065a779]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:22:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c50d31f0-70e7-4c7f-8d9f-a36135fdd249 tempest-TestStampPattern-2048838673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:28 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b Sep 25 17:22:28 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:29 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c50d31f0-70e7-4c7f-8d9f-a36135fdd249 tempest-TestStampPattern-2048838673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b" returned: 0 in 0.393s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:29 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-c50d31f0-70e7-4c7f-8d9f-a36135fdd249 tempest-TestStampPattern-2048838673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:22:29 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa496c7c-a5ed-471c-a21a-92fe4def2123]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:22:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c50d31f0-70e7-4c7f-8d9f-a36135fdd249 tempest-TestStampPattern-2048838673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:29 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 Sep 25 17:22:29 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-41b67416-57b1-4dea-a9bd-defddad1f712 tempest-VolumesCloneNegativeTest-372390740 None] Acquiring lock "cinder-d0aceadb-7017-4eae-80e4-2b88c980a0ad-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-41b67416-57b1-4dea-a9bd-defddad1f712 tempest-VolumesCloneNegativeTest-372390740 None] Lock "cinder-d0aceadb-7017-4eae-80e4-2b88c980a0ad-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-41b67416-57b1-4dea-a9bd-defddad1f712 tempest-VolumesCloneNegativeTest-372390740 None] Acquiring lock "cinder-quobyte-d0aceadb-7017-4eae-80e4-2b88c980a0ad" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-41b67416-57b1-4dea-a9bd-defddad1f712 tempest-VolumesCloneNegativeTest-372390740 None] Lock "cinder-quobyte-d0aceadb-7017-4eae-80e4-2b88c980a0ad" acquired by "delete_volume" :: waited 0.022s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:29 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[0608c9a9-ebb7-48b5-815e-308e729696fb]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:22:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-41b67416-57b1-4dea-a9bd-defddad1f712 tempest-VolumesCloneNegativeTest-372390740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d0aceadb-7017-4eae-80e4-2b88c980a0ad {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:29 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d0aceadb-7017-4eae-80e4-2b88c980a0ad Sep 25 17:22:29 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:29 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c50d31f0-70e7-4c7f-8d9f-a36135fdd249 tempest-TestStampPattern-2048838673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503" returned: 0 in 0.565s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c50d31f0-70e7-4c7f-8d9f-a36135fdd249 tempest-TestStampPattern-2048838673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:29 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b Sep 25 17:22:29 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:29 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-41b67416-57b1-4dea-a9bd-defddad1f712 tempest-VolumesCloneNegativeTest-372390740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d0aceadb-7017-4eae-80e4-2b88c980a0ad" returned: 0 in 0.388s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-41b67416-57b1-4dea-a9bd-defddad1f712 tempest-VolumesCloneNegativeTest-372390740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d0aceadb-7017-4eae-80e4-2b88c980a0ad {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:29 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d0aceadb-7017-4eae-80e4-2b88c980a0ad Sep 25 17:22:29 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:30 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-41b67416-57b1-4dea-a9bd-defddad1f712 tempest-VolumesCloneNegativeTest-372390740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d0aceadb-7017-4eae-80e4-2b88c980a0ad" returned: 0 in 0.269s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-41b67416-57b1-4dea-a9bd-defddad1f712 tempest-VolumesCloneNegativeTest-372390740 None] Lock "cinder-quobyte-d0aceadb-7017-4eae-80e4-2b88c980a0ad" released by "delete_volume" :: held 0.706s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:30 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c50d31f0-70e7-4c7f-8d9f-a36135fdd249 tempest-TestStampPattern-2048838673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b" returned: 0 in 0.372s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c50d31f0-70e7-4c7f-8d9f-a36135fdd249 tempest-TestStampPattern-2048838673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:30 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b Sep 25 17:22:30 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:30 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-41b67416-57b1-4dea-a9bd-defddad1f712 tempest-VolumesCloneNegativeTest-372390740 None] Created reservations ['16c9ca87-dce6-4160-8fcf-81608e20fc85', 'fe4be265-c40b-40b4-984d-70335337e2c0', 'e587a27f-580a-4a56-b57b-0bf06b24b444', '5eb95e17-f0ba-4ab7-9acb-1b8df3f0bd44'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:22:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-41b67416-57b1-4dea-a9bd-defddad1f712 tempest-VolumesCloneNegativeTest-372390740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-41b67416-57b1-4dea-a9bd-defddad1f712 tempest-VolumesCloneNegativeTest-372390740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-41b67416-57b1-4dea-a9bd-defddad1f712 tempest-VolumesCloneNegativeTest-372390740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:22:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-41b67416-57b1-4dea-a9bd-defddad1f712 tempest-VolumesCloneNegativeTest-372390740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:22:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-41b67416-57b1-4dea-a9bd-defddad1f712 tempest-VolumesCloneNegativeTest-372390740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-41b67416-57b1-4dea-a9bd-defddad1f712 tempest-VolumesCloneNegativeTest-372390740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:30 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:22:30 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:30 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c50d31f0-70e7-4c7f-8d9f-a36135fdd249 tempest-TestStampPattern-2048838673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503.6903a710-1d0f-4560-a527-2684461e1b6b" returned: 0 in 0.279s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c50d31f0-70e7-4c7f-8d9f-a36135fdd249 tempest-TestStampPattern-2048838673 None] Lock "cinder-quobyte-6903a710-1d0f-4560-a527-2684461e1b6b" released by "_delete_snapshot" :: held 1.748s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c50d31f0-70e7-4c7f-8d9f-a36135fdd249 tempest-TestStampPattern-2048838673 None] Lock "cinder-quobyte-1b27aa9e-bd71-46f9-b605-6e9f84af9503" released by "delete_snapshot" :: held 1.772s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:30 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-c50d31f0-70e7-4c7f-8d9f-a36135fdd249 tempest-TestStampPattern-2048838673 None] Created reservations ['6e6763ac-8a02-4f14-b9ee-dc722eb23640', '97f892d7-1a92-4323-b0c2-20031dfcf1fc', 'f5d26ebd-d4da-480a-a8b1-05909872cc8c', 'fe5a9d3e-6b6c-4291-8207-6a823e021054'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:22:30 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-41b67416-57b1-4dea-a9bd-defddad1f712 tempest-VolumesCloneNegativeTest-372390740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.304s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:30 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-41b67416-57b1-4dea-a9bd-defddad1f712 tempest-VolumesCloneNegativeTest-372390740 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:22:30 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-41b67416-57b1-4dea-a9bd-defddad1f712 tempest-VolumesCloneNegativeTest-372390740 None] Deleted volume successfully. Sep 25 17:22:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-41b67416-57b1-4dea-a9bd-defddad1f712 tempest-VolumesCloneNegativeTest-372390740 None] Lock "cinder-d0aceadb-7017-4eae-80e4-2b88c980a0ad-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:30 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-c50d31f0-70e7-4c7f-8d9f-a36135fdd249 tempest-TestStampPattern-2048838673 None] Delete snapshot completed successfully. Sep 25 17:22:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c50d31f0-70e7-4c7f-8d9f-a36135fdd249 tempest-TestStampPattern-2048838673 None] Lock "cinder-6903a710-1d0f-4560-a527-2684461e1b6b-delete_snapshot" released by "delete_snapshot" :: held 1.935s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6716a694-aba1-46ad-bb18-4182a0f5340a tempest-TestStampPattern-2048838673 None] Acquiring lock "cinder-1b27aa9e-bd71-46f9-b605-6e9f84af9503-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6716a694-aba1-46ad-bb18-4182a0f5340a tempest-TestStampPattern-2048838673 None] Lock "cinder-1b27aa9e-bd71-46f9-b605-6e9f84af9503-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6716a694-aba1-46ad-bb18-4182a0f5340a tempest-TestStampPattern-2048838673 None] Acquiring lock "cinder-quobyte-1b27aa9e-bd71-46f9-b605-6e9f84af9503" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6716a694-aba1-46ad-bb18-4182a0f5340a tempest-TestStampPattern-2048838673 None] Lock "cinder-quobyte-1b27aa9e-bd71-46f9-b605-6e9f84af9503" acquired by "delete_volume" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:35 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[346995bb-d373-4a06-ba4d-a041ce4bcc52]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:22:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6716a694-aba1-46ad-bb18-4182a0f5340a tempest-TestStampPattern-2048838673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:35 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 Sep 25 17:22:35 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:35 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6716a694-aba1-46ad-bb18-4182a0f5340a tempest-TestStampPattern-2048838673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503" returned: 0 in 0.390s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6716a694-aba1-46ad-bb18-4182a0f5340a tempest-TestStampPattern-2048838673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:35 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503 Sep 25 17:22:35 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:35 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6716a694-aba1-46ad-bb18-4182a0f5340a tempest-TestStampPattern-2048838673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-1b27aa9e-bd71-46f9-b605-6e9f84af9503" returned: 0 in 0.254s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6716a694-aba1-46ad-bb18-4182a0f5340a tempest-TestStampPattern-2048838673 None] Lock "cinder-quobyte-1b27aa9e-bd71-46f9-b605-6e9f84af9503" released by "delete_volume" :: held 0.707s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:35 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-6716a694-aba1-46ad-bb18-4182a0f5340a tempest-TestStampPattern-2048838673 None] Created reservations ['93a2b275-1c80-4f86-b367-98ea80eaab3b', 'b42b22b4-5d05-4764-a80c-57fa36cf7aa9', 'bc5985bf-157a-4edb-bc94-249d28f4ccf3', 'd3189d6f-fe2c-4db4-a5da-19034c002367'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:22:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6716a694-aba1-46ad-bb18-4182a0f5340a tempest-TestStampPattern-2048838673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6716a694-aba1-46ad-bb18-4182a0f5340a tempest-TestStampPattern-2048838673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:35 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6716a694-aba1-46ad-bb18-4182a0f5340a tempest-TestStampPattern-2048838673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:22:35 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6716a694-aba1-46ad-bb18-4182a0f5340a tempest-TestStampPattern-2048838673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:22:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6716a694-aba1-46ad-bb18-4182a0f5340a tempest-TestStampPattern-2048838673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6716a694-aba1-46ad-bb18-4182a0f5340a tempest-TestStampPattern-2048838673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:35 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:22:35 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:36 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6716a694-aba1-46ad-bb18-4182a0f5340a tempest-TestStampPattern-2048838673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.241s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:36 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-6716a694-aba1-46ad-bb18-4182a0f5340a tempest-TestStampPattern-2048838673 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:22:36 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-6716a694-aba1-46ad-bb18-4182a0f5340a tempest-TestStampPattern-2048838673 None] Deleted volume successfully. Sep 25 17:22:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6716a694-aba1-46ad-bb18-4182a0f5340a tempest-TestStampPattern-2048838673 None] Lock "cinder-1b27aa9e-bd71-46f9-b605-6e9f84af9503-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:45 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:UPDATE=74,cinder:DELETE=5,cinder:SELECT=61,cinder:INSERT=20 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:22:46 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=62,cinder:INSERT=20,cinder:UPDATE=85,cinder:DELETE=6 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:22:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:22:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:22:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:22:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:53 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:22:53 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:53 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.297s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:53 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:22:54 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:22:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 28 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:22:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:23:07 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:23:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Flow 'volume_create_manager' (98ccc03a-fe2d-4334-a0f7-f6b01c87b4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:23:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19fdf841-6efa-4808-89e3-4b8b37e19948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19fdf841-6efa-4808-89e3-4b8b37e19948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1409554730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce02cd75-e466-4cbf-a7c8-8a5f78050e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db21a281e5f64b2c827a6b118138cd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:08Z,use_quota=True,user_id='e18e4bc4ac7941e7be4db684ac7473ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5073210a-2136-425a-a9d7-b16cbe55cde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5073210a-2136-425a-a9d7-b16cbe55cde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c61223-714f-4c23-9456-fc8d89909082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c61223-714f-4c23-9456-fc8d89909082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce02cd75-e466-4cbf-a7c8-8a5f78050e4f', 'volume_name': 'volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02fe9e7e-0a87-4742-a4b1-0108162c7c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02fe9e7e-0a87-4742-a4b1-0108162c7c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fea59d8-263d-4fd3-8095-a519ecf97ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:07 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Volume ce02cd75-e466-4cbf-a7c8-8a5f78050e4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f', 'volume_size': 1} Sep 25 17:23:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1409554730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce02cd75-e466-4cbf-a7c8-8a5f78050e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db21a281e5f64b2c827a6b118138cd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:08Z,use_quota=True,user_id='e18e4bc4ac7941e7be4db684ac7473ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:23:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Creating volume ce02cd75-e466-4cbf-a7c8-8a5f78050e4f {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:23:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:23:07 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:23:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:07 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f 1073741824 Sep 25 17:23:07 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:08 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f 1073741824" returned: 0 in 0.415s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:08 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f Sep 25 17:23:08 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:08 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f" returned: 0 in 0.235s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:23:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fea59d8-263d-4fd3-8095-a519ecf97ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08f4604-744c-4754-abc2-e258a564cfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:08 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Volume volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f (ce02cd75-e466-4cbf-a7c8-8a5f78050e4f): created successfully Sep 25 17:23:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08f4604-744c-4754-abc2-e258a564cfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Flow 'volume_create_manager' (98ccc03a-fe2d-4334-a0f7-f6b01c87b4ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:23:08 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-759e19b6-699b-4387-9692-21b9b377b69f tempest-SnapshotDependencyTests-98962718 None] Created volume successfully. Sep 25 17:23:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e409643e-1a37-4d1f-97d5-4299b2636d29 tempest-SnapshotDependencyTests-98962718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e409643e-1a37-4d1f-97d5-4299b2636d29 tempest-SnapshotDependencyTests-98962718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-e409643e-1a37-4d1f-97d5-4299b2636d29 tempest-SnapshotDependencyTests-98962718 None] Creating offline snapshot 999b4ebd-c0fb-4aa4-931f-e077f754f063 of volume ce02cd75-e466-4cbf-a7c8-8a5f78050e4f {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:23:08 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ff797a-b97f-458d-9f98-f52f5c5ce823]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e409643e-1a37-4d1f-97d5-4299b2636d29 tempest-SnapshotDependencyTests-98962718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:09 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f Sep 25 17:23:09 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:09 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e409643e-1a37-4d1f-97d5-4299b2636d29 tempest-SnapshotDependencyTests-98962718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f" returned: 0 in 0.346s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e409643e-1a37-4d1f-97d5-4299b2636d29 tempest-SnapshotDependencyTests-98962718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:09 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063 1G Sep 25 17:23:09 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:09 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e409643e-1a37-4d1f-97d5-4299b2636d29 tempest-SnapshotDependencyTests-98962718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063 1G" returned: 0 in 0.381s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e409643e-1a37-4d1f-97d5-4299b2636d29 tempest-SnapshotDependencyTests-98962718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:09 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063 Sep 25 17:23:09 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:09 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e409643e-1a37-4d1f-97d5-4299b2636d29 tempest-SnapshotDependencyTests-98962718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063" returned: 0 in 0.282s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:09 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-e409643e-1a37-4d1f-97d5-4299b2636d29 tempest-SnapshotDependencyTests-98962718 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063 is being set with open permissions: ugo+rw Sep 25 17:23:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e409643e-1a37-4d1f-97d5-4299b2636d29 tempest-SnapshotDependencyTests-98962718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:10 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063 Sep 25 17:23:10 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:10 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e409643e-1a37-4d1f-97d5-4299b2636d29 tempest-SnapshotDependencyTests-98962718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063" returned: 0 in 0.243s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e409643e-1a37-4d1f-97d5-4299b2636d29 tempest-SnapshotDependencyTests-98962718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:10 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.info Sep 25 17:23:10 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:10 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e409643e-1a37-4d1f-97d5-4299b2636d29 tempest-SnapshotDependencyTests-98962718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.info" returned: 0 in 0.253s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:10 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-e409643e-1a37-4d1f-97d5-4299b2636d29 tempest-SnapshotDependencyTests-98962718 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.info is being set with open permissions: ugo+rw Sep 25 17:23:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e409643e-1a37-4d1f-97d5-4299b2636d29 tempest-SnapshotDependencyTests-98962718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:10 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.info Sep 25 17:23:10 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:10 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e409643e-1a37-4d1f-97d5-4299b2636d29 tempest-SnapshotDependencyTests-98962718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.info" returned: 0 in 0.243s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e409643e-1a37-4d1f-97d5-4299b2636d29 tempest-SnapshotDependencyTests-98962718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.842s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:10 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-e409643e-1a37-4d1f-97d5-4299b2636d29 tempest-SnapshotDependencyTests-98962718 None] Create snapshot completed successfully Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Flow 'volume_create_manager' (f5747304-387c-41a7-9407-ad7d3b9a098d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e95f2d-deca-482e-8d7a-ed5b39839aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e95f2d-deca-482e-8d7a-ed5b39839aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d459f8-41ca-4c3c-840e-c2b8deab1458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db21a281e5f64b2c827a6b118138cd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=999b4ebd-c0fb-4aa4-931f-e077f754f063,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:12Z,use_quota=True,user_id='e18e4bc4ac7941e7be4db684ac7473ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a21b7d-6520-4e72-865f-09a7b4ed44b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a21b7d-6520-4e72-865f-09a7b4ed44b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a91fe5aa-a966-4530-b8b8-e1636af1c3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a91fe5aa-a966-4530-b8b8-e1636af1c3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '24d459f8-41ca-4c3c-840e-c2b8deab1458', 'volume_name': 'volume-24d459f8-41ca-4c3c-840e-c2b8deab1458', 'volume_size': 1, 'snapshot_id': '999b4ebd-c0fb-4aa4-931f-e077f754f063'}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77f1294-4d52-4c9d-8ee3-9ca5d851ce5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77f1294-4d52-4c9d-8ee3-9ca5d851ce5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af66e888-8bf9-4cde-afc7-97b4546d8eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:11 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Volume 24d459f8-41ca-4c3c-840e-c2b8deab1458: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-24d459f8-41ca-4c3c-840e-c2b8deab1458', 'volume_size': 1, 'snapshot_id': '999b4ebd-c0fb-4aa4-931f-e077f754f063'} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Acquiring lock "cinder-quobyte-999b4ebd-c0fb-4aa4-931f-e077f754f063-24d459f8-41ca-4c3c-840e-c2b8deab1458" by "_create_volume_from_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Lock "cinder-quobyte-999b4ebd-c0fb-4aa4-931f-e077f754f063-24d459f8-41ca-4c3c-840e-c2b8deab1458" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Creating volume 24d459f8-41ca-4c3c-840e-c2b8deab1458 from snapshot 999b4ebd-c0fb-4aa4-931f-e077f754f063 {{(pid=87211) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Acquiring lock "cinder-quobyte-24d459f8-41ca-4c3c-840e-c2b8deab1458" by "_copy_volume_from_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Lock "cinder-quobyte-24d459f8-41ca-4c3c-840e-c2b8deab1458" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] snapshot: 999b4ebd-c0fb-4aa4-931f-e077f754f063, volume: 24d459f8-41ca-4c3c-840e-c2b8deab1458, {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f58f9c-8165-44e0-b463-11abe4a8fd13]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:11 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063 Sep 25 17:23:11 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:12 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063" returned: 0 in 0.352s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:23:12 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab793281-95bd-41cc-8c74-96e9972dcc37]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:12 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f Sep 25 17:23:12 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:12 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f" returned: 0 in 0.357s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] will copy from snapshot at /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:23:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Creating direct copy from snapshot {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:23:12 devstack cinder-volume[87211]: DEBUG cinder.utils [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Path /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24d459f8-41ca-4c3c-840e-c2b8deab1458 not found in is_blk_device check {{(pid=87211) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:23:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24d459f8-41ca-4c3c-840e-c2b8deab1458 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:12 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24d459f8-41ca-4c3c-840e-c2b8deab1458 Sep 25 17:23:12 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:18 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24d459f8-41ca-4c3c-840e-c2b8deab1458" returned: 0 in 5.968s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:18 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Image conversion details: src /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f, size 1024.00 MB, duration 5.97 sec, destination /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24d459f8-41ca-4c3c-840e-c2b8deab1458 {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:23:18 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Converted 1024.00 MB image at 171.56 MB/s Sep 25 17:23:18 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24d459f8-41ca-4c3c-840e-c2b8deab1458 is being set with open permissions: ugo+rw Sep 25 17:23:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24d459f8-41ca-4c3c-840e-c2b8deab1458 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:18 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24d459f8-41ca-4c3c-840e-c2b8deab1458 Sep 25 17:23:18 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:18 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24d459f8-41ca-4c3c-840e-c2b8deab1458" returned: 0 in 0.241s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:18 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Lock "cinder-quobyte-24d459f8-41ca-4c3c-840e-c2b8deab1458" released by "_copy_volume_from_snapshot" :: held 7.000s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:18 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Lock "cinder-quobyte-999b4ebd-c0fb-4aa4-931f-e077f754f063-24d459f8-41ca-4c3c-840e-c2b8deab1458" released by "_create_volume_from_snapshot" :: held 7.062s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.079s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:18 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af66e888-8bf9-4cde-afc7-97b4546d8eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24d459f8-41ca-4c3c-840e-c2b8deab1458', 'volume_size': 1, 'snapshot_id': '999b4ebd-c0fb-4aa4-931f-e077f754f063'}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:18 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54987939-7e2d-4455-b05f-480895da462f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:18 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Volume volume-24d459f8-41ca-4c3c-840e-c2b8deab1458 (24d459f8-41ca-4c3c-840e-c2b8deab1458): created successfully Sep 25 17:23:18 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54987939-7e2d-4455-b05f-480895da462f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:18 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Flow 'volume_create_manager' (f5747304-387c-41a7-9407-ad7d3b9a098d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:23:18 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-6684b292-56ee-4f74-9712-c1f16f65951a tempest-SnapshotDependencyTests-98962718 None] Created volume successfully. Sep 25 17:23:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b4e63f02-19c2-4305-be72-94491cfd44f5 tempest-SnapshotDependencyTests-98962718 None] Acquiring lock "cinder-999b4ebd-c0fb-4aa4-931f-e077f754f063-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b4e63f02-19c2-4305-be72-94491cfd44f5 tempest-SnapshotDependencyTests-98962718 None] Lock "cinder-999b4ebd-c0fb-4aa4-931f-e077f754f063-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b4e63f02-19c2-4305-be72-94491cfd44f5 tempest-SnapshotDependencyTests-98962718 None] Acquiring lock "cinder-quobyte-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b4e63f02-19c2-4305-be72-94491cfd44f5 tempest-SnapshotDependencyTests-98962718 None] Lock "cinder-quobyte-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b4e63f02-19c2-4305-be72-94491cfd44f5 tempest-SnapshotDependencyTests-98962718 None] Acquiring lock "cinder-quobyte-999b4ebd-c0fb-4aa4-931f-e077f754f063" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b4e63f02-19c2-4305-be72-94491cfd44f5 tempest-SnapshotDependencyTests-98962718 None] Lock "cinder-quobyte-999b4ebd-c0fb-4aa4-931f-e077f754f063" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b4e63f02-19c2-4305-be72-94491cfd44f5 tempest-SnapshotDependencyTests-98962718 None] Deleting offline snapshot 999b4ebd-c0fb-4aa4-931f-e077f754f063 of volume ce02cd75-e466-4cbf-a7c8-8a5f78050e4f {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:23:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b4e63f02-19c2-4305-be72-94491cfd44f5 tempest-SnapshotDependencyTests-98962718 None] snapshot_file for this snap is: volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:23:19 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00ca3a1-6c8f-4333-8ada-300b16973fca]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b4e63f02-19c2-4305-be72-94491cfd44f5 tempest-SnapshotDependencyTests-98962718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:19 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063 Sep 25 17:23:19 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:19 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b4e63f02-19c2-4305-be72-94491cfd44f5 tempest-SnapshotDependencyTests-98962718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063" returned: 0 in 0.378s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b4e63f02-19c2-4305-be72-94491cfd44f5 tempest-SnapshotDependencyTests-98962718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:23:19 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5dc39a-af32-42f4-babe-2432ebe9ef60]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b4e63f02-19c2-4305-be72-94491cfd44f5 tempest-SnapshotDependencyTests-98962718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:20 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f Sep 25 17:23:20 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:20 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b4e63f02-19c2-4305-be72-94491cfd44f5 tempest-SnapshotDependencyTests-98962718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f" returned: 0 in 0.568s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b4e63f02-19c2-4305-be72-94491cfd44f5 tempest-SnapshotDependencyTests-98962718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:20 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063 Sep 25 17:23:20 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:20 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b4e63f02-19c2-4305-be72-94491cfd44f5 tempest-SnapshotDependencyTests-98962718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063" returned: 0 in 0.336s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b4e63f02-19c2-4305-be72-94491cfd44f5 tempest-SnapshotDependencyTests-98962718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:20 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063 Sep 25 17:23:20 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:21 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b4e63f02-19c2-4305-be72-94491cfd44f5 tempest-SnapshotDependencyTests-98962718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f.999b4ebd-c0fb-4aa4-931f-e077f754f063" returned: 0 in 0.249s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b4e63f02-19c2-4305-be72-94491cfd44f5 tempest-SnapshotDependencyTests-98962718 None] Lock "cinder-quobyte-999b4ebd-c0fb-4aa4-931f-e077f754f063" released by "_delete_snapshot" :: held 1.657s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b4e63f02-19c2-4305-be72-94491cfd44f5 tempest-SnapshotDependencyTests-98962718 None] Lock "cinder-quobyte-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f" released by "delete_snapshot" :: held 1.681s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:21 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-b4e63f02-19c2-4305-be72-94491cfd44f5 tempest-SnapshotDependencyTests-98962718 None] Created reservations ['4944ac83-bac3-43dc-85fb-70b83c01e39b', 'e012f0f0-2a4a-43cc-ba62-364f5c9c3b7e', '4da59597-67a9-4eeb-a505-a317c7572102', 'baf3c176-77f7-4960-a09d-8170fc510b16'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:23:21 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b4e63f02-19c2-4305-be72-94491cfd44f5 tempest-SnapshotDependencyTests-98962718 None] Delete snapshot completed successfully. Sep 25 17:23:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b4e63f02-19c2-4305-be72-94491cfd44f5 tempest-SnapshotDependencyTests-98962718 None] Lock "cinder-999b4ebd-c0fb-4aa4-931f-e077f754f063-delete_snapshot" released by "delete_snapshot" :: held 1.814s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-351d920d-bb79-4b33-b178-e9a31ab30f04 tempest-SnapshotDependencyTests-98962718 None] Acquiring lock "cinder-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-351d920d-bb79-4b33-b178-e9a31ab30f04 tempest-SnapshotDependencyTests-98962718 None] Lock "cinder-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-351d920d-bb79-4b33-b178-e9a31ab30f04 tempest-SnapshotDependencyTests-98962718 None] Acquiring lock "cinder-quobyte-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-351d920d-bb79-4b33-b178-e9a31ab30f04 tempest-SnapshotDependencyTests-98962718 None] Lock "cinder-quobyte-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f" acquired by "delete_volume" :: waited 0.013s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:21 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[a177a0d5-eb90-4218-ae0d-709d6e61b639]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-351d920d-bb79-4b33-b178-e9a31ab30f04 tempest-SnapshotDependencyTests-98962718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:21 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f Sep 25 17:23:21 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:22 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-351d920d-bb79-4b33-b178-e9a31ab30f04 tempest-SnapshotDependencyTests-98962718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f" returned: 0 in 0.348s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-351d920d-bb79-4b33-b178-e9a31ab30f04 tempest-SnapshotDependencyTests-98962718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:22 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f Sep 25 17:23:22 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:22 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-351d920d-bb79-4b33-b178-e9a31ab30f04 tempest-SnapshotDependencyTests-98962718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f" returned: 0 in 0.238s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-351d920d-bb79-4b33-b178-e9a31ab30f04 tempest-SnapshotDependencyTests-98962718 None] Lock "cinder-quobyte-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f" released by "delete_volume" :: held 0.643s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:22 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-351d920d-bb79-4b33-b178-e9a31ab30f04 tempest-SnapshotDependencyTests-98962718 None] Created reservations ['a6002900-340e-4514-ade9-23bf77e19303', 'c641dcc7-b862-45e3-8a3e-5627a087fd80', 'f02249a4-0172-482b-9b49-2ad50554431b', 'cacab5d7-a188-43ae-ba69-5b000e764529'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:23:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-351d920d-bb79-4b33-b178-e9a31ab30f04 tempest-SnapshotDependencyTests-98962718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-351d920d-bb79-4b33-b178-e9a31ab30f04 tempest-SnapshotDependencyTests-98962718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-351d920d-bb79-4b33-b178-e9a31ab30f04 tempest-SnapshotDependencyTests-98962718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-351d920d-bb79-4b33-b178-e9a31ab30f04 tempest-SnapshotDependencyTests-98962718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-351d920d-bb79-4b33-b178-e9a31ab30f04 tempest-SnapshotDependencyTests-98962718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-351d920d-bb79-4b33-b178-e9a31ab30f04 tempest-SnapshotDependencyTests-98962718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:22 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:23:22 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:22 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-351d920d-bb79-4b33-b178-e9a31ab30f04 tempest-SnapshotDependencyTests-98962718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.254s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:22 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-351d920d-bb79-4b33-b178-e9a31ab30f04 tempest-SnapshotDependencyTests-98962718 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:23:22 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-351d920d-bb79-4b33-b178-e9a31ab30f04 tempest-SnapshotDependencyTests-98962718 None] Deleted volume successfully. Sep 25 17:23:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-351d920d-bb79-4b33-b178-e9a31ab30f04 tempest-SnapshotDependencyTests-98962718 None] Lock "cinder-ce02cd75-e466-4cbf-a7c8-8a5f78050e4f-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-80eaff2f-5061-4a20-8557-47c95c45f510 tempest-SnapshotDependencyTests-98962718 None] Acquiring lock "cinder-24d459f8-41ca-4c3c-840e-c2b8deab1458-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-80eaff2f-5061-4a20-8557-47c95c45f510 tempest-SnapshotDependencyTests-98962718 None] Lock "cinder-24d459f8-41ca-4c3c-840e-c2b8deab1458-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-80eaff2f-5061-4a20-8557-47c95c45f510 tempest-SnapshotDependencyTests-98962718 None] Acquiring lock "cinder-quobyte-24d459f8-41ca-4c3c-840e-c2b8deab1458" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-80eaff2f-5061-4a20-8557-47c95c45f510 tempest-SnapshotDependencyTests-98962718 None] Lock "cinder-quobyte-24d459f8-41ca-4c3c-840e-c2b8deab1458" acquired by "delete_volume" :: waited 0.014s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:22 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d7ce66-84ed-4b58-aacb-236006314e9e]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-80eaff2f-5061-4a20-8557-47c95c45f510 tempest-SnapshotDependencyTests-98962718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24d459f8-41ca-4c3c-840e-c2b8deab1458 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:22 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24d459f8-41ca-4c3c-840e-c2b8deab1458 Sep 25 17:23:22 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:23 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-80eaff2f-5061-4a20-8557-47c95c45f510 tempest-SnapshotDependencyTests-98962718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24d459f8-41ca-4c3c-840e-c2b8deab1458" returned: 0 in 0.355s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-80eaff2f-5061-4a20-8557-47c95c45f510 tempest-SnapshotDependencyTests-98962718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24d459f8-41ca-4c3c-840e-c2b8deab1458 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:23 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24d459f8-41ca-4c3c-840e-c2b8deab1458 Sep 25 17:23:23 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:23 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-80eaff2f-5061-4a20-8557-47c95c45f510 tempest-SnapshotDependencyTests-98962718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-24d459f8-41ca-4c3c-840e-c2b8deab1458" returned: 0 in 0.246s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-80eaff2f-5061-4a20-8557-47c95c45f510 tempest-SnapshotDependencyTests-98962718 None] Lock "cinder-quobyte-24d459f8-41ca-4c3c-840e-c2b8deab1458" released by "delete_volume" :: held 0.641s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:23 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-80eaff2f-5061-4a20-8557-47c95c45f510 tempest-SnapshotDependencyTests-98962718 None] Created reservations ['92c76e8c-c658-42fd-9450-6dc45bc52046', '3b7c257a-1633-4e58-a569-4727e7926631', 'f0c8aeec-be05-4c1b-82c4-1e2c173b42a7', '626796fb-64dc-422f-bdc6-4012e040b453'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:23:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-80eaff2f-5061-4a20-8557-47c95c45f510 tempest-SnapshotDependencyTests-98962718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-80eaff2f-5061-4a20-8557-47c95c45f510 tempest-SnapshotDependencyTests-98962718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-80eaff2f-5061-4a20-8557-47c95c45f510 tempest-SnapshotDependencyTests-98962718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-80eaff2f-5061-4a20-8557-47c95c45f510 tempest-SnapshotDependencyTests-98962718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-80eaff2f-5061-4a20-8557-47c95c45f510 tempest-SnapshotDependencyTests-98962718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-80eaff2f-5061-4a20-8557-47c95c45f510 tempest-SnapshotDependencyTests-98962718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:23 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:23:23 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:23 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-80eaff2f-5061-4a20-8557-47c95c45f510 tempest-SnapshotDependencyTests-98962718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.240s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:23 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-80eaff2f-5061-4a20-8557-47c95c45f510 tempest-SnapshotDependencyTests-98962718 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:23:23 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-80eaff2f-5061-4a20-8557-47c95c45f510 tempest-SnapshotDependencyTests-98962718 None] Deleted volume successfully. Sep 25 17:23:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-80eaff2f-5061-4a20-8557-47c95c45f510 tempest-SnapshotDependencyTests-98962718 None] Lock "cinder-24d459f8-41ca-4c3c-840e-c2b8deab1458-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:33 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:UPDATE=30,cinder:INSERT=7,cinder:DELETE=3,cinder:SELECT=22 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:23:33 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=28,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:23:44 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:23:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Flow 'volume_create_manager' (ac6886db-b380-409f-8a9d-f23147a80677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:23:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb19724-1f1c-49c7-9102-d5bf77b65a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb19724-1f1c-49c7-9102-d5bf77b65a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1028023225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df2c51c4-b2b0-4233-b17d-c465b2a699c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8bf4f8526894b97842929251fb2cbeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:45Z,use_quota=True,user_id='6962edf72af04befa09ff582cdfbcb3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d40581a-e2a0-4f4f-b487-b1a907c0f4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d40581a-e2a0-4f4f-b487-b1a907c0f4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9256b1-0e1f-4ab1-8417-6c0e2fc493eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9256b1-0e1f-4ab1-8417-6c0e2fc493eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df2c51c4-b2b0-4233-b17d-c465b2a699c4', 'volume_name': 'volume-df2c51c4-b2b0-4233-b17d-c465b2a699c4', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b964ed8-1ceb-49e9-ab10-8893a795413f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b964ed8-1ceb-49e9-ab10-8893a795413f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06166f4a-5adf-4374-8de5-5392113cb9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:44 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Volume df2c51c4-b2b0-4233-b17d-c465b2a699c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df2c51c4-b2b0-4233-b17d-c465b2a699c4', 'volume_size': 1} Sep 25 17:23:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1028023225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df2c51c4-b2b0-4233-b17d-c465b2a699c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8bf4f8526894b97842929251fb2cbeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:45Z,use_quota=True,user_id='6962edf72af04befa09ff582cdfbcb3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:23:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Creating volume df2c51c4-b2b0-4233-b17d-c465b2a699c4 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:23:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:23:44 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:23:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-df2c51c4-b2b0-4233-b17d-c465b2a699c4 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:44 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-df2c51c4-b2b0-4233-b17d-c465b2a699c4 1073741824 Sep 25 17:23:44 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Flow 'volume_create_manager' (62307621-c019-4c1a-a3fb-b1b316fe6fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (638357d6-f794-4607-a4cf-4e86a62eb015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (638357d6-f794-4607-a4cf-4e86a62eb015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-549188167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd66abda-1485-4902-9f60-838b9d783449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74145e8a7118498aa1c24e7a89901736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:45Z,use_quota=True,user_id='49d420fb67b44ef3a20bbc5d49b673f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744c9627-74ad-406e-ad91-c1407f11c4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:45 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744c9627-74ad-406e-ad91-c1407f11c4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61136e4f-7c9c-4c80-8eb6-f1261a5deeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61136e4f-7c9c-4c80-8eb6-f1261a5deeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd66abda-1485-4902-9f60-838b9d783449', 'volume_name': 'volume-bd66abda-1485-4902-9f60-838b9d783449', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e6e843-f292-49af-9583-59d6e55e8e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e6e843-f292-49af-9583-59d6e55e8e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e80f19ac-ac62-423c-aa4e-2016f969c6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:45 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Volume bd66abda-1485-4902-9f60-838b9d783449: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd66abda-1485-4902-9f60-838b9d783449', 'volume_size': 1} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-df2c51c4-b2b0-4233-b17d-c465b2a699c4 1073741824" returned: 0 in 0.782s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Flow 'volume_create_manager' (baf44f51-68cc-4020-a3f1-b6ab94e13513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12badfaa-4feb-4a1c-a097-d111f5a36bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-df2c51c4-b2b0-4233-b17d-c465b2a699c4 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12badfaa-4feb-4a1c-a097-d111f5a36bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1864715965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8bf4f8526894b97842929251fb2cbeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:45Z,use_quota=True,user_id='6962edf72af04befa09ff582cdfbcb3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98575d3f-0839-413a-9b72-2f4d7b367ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98575d3f-0839-413a-9b72-2f4d7b367ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35cad26-15cb-4117-b36e-67f21bdf20b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:45 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-df2c51c4-b2b0-4233-b17d-c465b2a699c4 Sep 25 17:23:45 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35cad26-15cb-4117-b36e-67f21bdf20b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8', 'volume_name': 'volume-3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46e86f0-3ac6-4d88-9574-31ce7858a9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46e86f0-3ac6-4d88-9574-31ce7858a9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f4fcd7-47e8-40f4-8888-31ca3d9c2e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:45 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Volume 3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8', 'volume_size': 1} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Flow 'volume_create_manager' (7e923aa6-9fdc-42f4-a9ea-70df0d1fca5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:23:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9155f85-b4a6-46e7-ad0b-6e801885297e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9155f85-b4a6-46e7-ad0b-6e801885297e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1600643228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba496051-b690-4c7c-959b-3292aa3c9a4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8bf4f8526894b97842929251fb2cbeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:46Z,use_quota=True,user_id='6962edf72af04befa09ff582cdfbcb3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5540814-3ba1-440f-be0d-d210c15193c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5540814-3ba1-440f-be0d-d210c15193c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f57887-0ae5-43e6-b289-53e28e8079b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f57887-0ae5-43e6-b289-53e28e8079b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba496051-b690-4c7c-959b-3292aa3c9a4c', 'volume_name': 'volume-ba496051-b690-4c7c-959b-3292aa3c9a4c', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f9c585-26c5-436d-84c1-6dd12d969f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f9c585-26c5-436d-84c1-6dd12d969f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c4332fa-abfb-4daf-b035-e018256d97c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:46 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Volume ba496051-b690-4c7c-959b-3292aa3c9a4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba496051-b690-4c7c-959b-3292aa3c9a4c', 'volume_size': 1} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:46 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-df2c51c4-b2b0-4233-b17d-c465b2a699c4" returned: 0 in 0.436s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.522s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-549188167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd66abda-1485-4902-9f60-838b9d783449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74145e8a7118498aa1c24e7a89901736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:45Z,use_quota=True,user_id='49d420fb67b44ef3a20bbc5d49b673f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Creating volume bd66abda-1485-4902-9f60-838b9d783449 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:23:46 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06166f4a-5adf-4374-8de5-5392113cb9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df2c51c4-b2b0-4233-b17d-c465b2a699c4', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d655ac1d-7888-45f7-bf81-97b8a9f5428e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:46 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449 1073741824 Sep 25 17:23:46 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:46 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Volume volume-df2c51c4-b2b0-4233-b17d-c465b2a699c4 (df2c51c4-b2b0-4233-b17d-c465b2a699c4): created successfully Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d655ac1d-7888-45f7-bf81-97b8a9f5428e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Flow 'volume_create_manager' (ac6886db-b380-409f-8a9d-f23147a80677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:23:46 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-8b6f9070-ed9a-4049-9618-fef40992c3ca tempest-CreateVolumesFromImageTest-221076571 None] Created volume successfully. Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Flow 'volume_create_manager' (e28eaa3b-7041-4423-ae29-8a99fb305323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2f8e28-bea8-403a-aa6a-6a572792d3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2f8e28-bea8-403a-aa6a-6a572792d3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-368977692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b866e8a-b96c-4eb7-afbd-ab0f3421fec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8bf4f8526894b97842929251fb2cbeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:46Z,use_quota=True,user_id='6962edf72af04befa09ff582cdfbcb3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05dfd8c-c07a-4308-b030-3d714d010f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05dfd8c-c07a-4308-b030-3d714d010f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08176f4c-e858-4c3a-a0b6-2a36ac8e341f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08176f4c-e858-4c3a-a0b6-2a36ac8e341f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b866e8a-b96c-4eb7-afbd-ab0f3421fec7', 'volume_name': 'volume-9b866e8a-b96c-4eb7-afbd-ab0f3421fec7', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ca574a-803a-4192-bc1e-7557e95d2489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ca574a-803a-4192-bc1e-7557e95d2489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a6abde8-08a1-4fc2-a41c-c8455a72bdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:46 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Volume 9b866e8a-b96c-4eb7-afbd-ab0f3421fec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b866e8a-b96c-4eb7-afbd-ab0f3421fec7', 'volume_size': 1} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:46 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449 1073741824" returned: 0 in 0.720s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:46 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449 Sep 25 17:23:46 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:46 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Flow 'volume_create_manager' (16643715-f07c-4d28-8340-80e9cbaccc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f52559c-cc74-48ba-9274-b3b81d7105d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f52559c-cc74-48ba-9274-b3b81d7105d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1293570912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9e2e81-70a0-49da-8b7a-d5cc1d45a606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8bf4f8526894b97842929251fb2cbeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:47Z,use_quota=True,user_id='6962edf72af04befa09ff582cdfbcb3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b4f875c-da1b-4570-a924-bccdaabb81f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b4f875c-da1b-4570-a924-bccdaabb81f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df0d0b3b-3ed0-4652-a40f-48381e7492a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df0d0b3b-3ed0-4652-a40f-48381e7492a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f9e2e81-70a0-49da-8b7a-d5cc1d45a606', 'volume_name': 'volume-5f9e2e81-70a0-49da-8b7a-d5cc1d45a606', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc94e78c-50ba-47d3-aefe-c8c30137801e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc94e78c-50ba-47d3-aefe-c8c30137801e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262fdf3a-1157-4905-8f3e-c202b17df346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:47 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Volume 5f9e2e81-70a0-49da-8b7a-d5cc1d45a606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f9e2e81-70a0-49da-8b7a-d5cc1d45a606', 'volume_size': 1} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:47 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449" returned: 0 in 0.333s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.523s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1864715965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8bf4f8526894b97842929251fb2cbeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:45Z,use_quota=True,user_id='6962edf72af04befa09ff582cdfbcb3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Creating volume 3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:23:47 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e80f19ac-ac62-423c-aa4e-2016f969c6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd66abda-1485-4902-9f60-838b9d783449', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:47 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8 1073741824 Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f714fb4c-ce81-4d92-a643-ad2ceb2f4a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:47 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:47 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Volume volume-bd66abda-1485-4902-9f60-838b9d783449 (bd66abda-1485-4902-9f60-838b9d783449): created successfully Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f714fb4c-ce81-4d92-a643-ad2ceb2f4a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Flow 'volume_create_manager' (62307621-c019-4c1a-a3fb-b1b316fe6fec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:23:47 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-1a4aa456-4518-4713-a78e-79aa2606cfd7 tempest-VolumeDependencyTests-2109449245 None] Created volume successfully. Sep 25 17:23:47 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8 1073741824" returned: 0 in 0.536s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:47 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8 Sep 25 17:23:47 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:48 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8" returned: 0 in 0.296s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:23:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.060s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1600643228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba496051-b690-4c7c-959b-3292aa3c9a4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8bf4f8526894b97842929251fb2cbeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:46Z,use_quota=True,user_id='6962edf72af04befa09ff582cdfbcb3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:23:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Creating volume ba496051-b690-4c7c-959b-3292aa3c9a4c {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:23:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:23:48 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:23:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ba496051-b690-4c7c-959b-3292aa3c9a4c 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f4fcd7-47e8-40f4-8888-31ca3d9c2e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9aaa0a-80c8-4a49-8f75-5fe34249eb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:48 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ba496051-b690-4c7c-959b-3292aa3c9a4c 1073741824 Sep 25 17:23:48 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:48 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Volume volume-3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8 (3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8): created successfully Sep 25 17:23:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9aaa0a-80c8-4a49-8f75-5fe34249eb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Flow 'volume_create_manager' (baf44f51-68cc-4020-a3f1-b6ab94e13513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:23:48 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-5de36af7-0cb4-4bde-a0db-287d64f40a56 tempest-CreateVolumesFromImageTest-221076571 None] Created volume successfully. Sep 25 17:23:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-398d7e88-4b0f-49ff-bd7a-09b717c51d41 tempest-VolumeDependencyTests-2109449245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:48 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ba496051-b690-4c7c-959b-3292aa3c9a4c 1073741824" returned: 0 in 0.676s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ba496051-b690-4c7c-959b-3292aa3c9a4c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:48 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ba496051-b690-4c7c-959b-3292aa3c9a4c Sep 25 17:23:48 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:49 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ba496051-b690-4c7c-959b-3292aa3c9a4c" returned: 0 in 0.441s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:23:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.759s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-368977692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b866e8a-b96c-4eb7-afbd-ab0f3421fec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8bf4f8526894b97842929251fb2cbeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:46Z,use_quota=True,user_id='6962edf72af04befa09ff582cdfbcb3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:23:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Creating volume 9b866e8a-b96c-4eb7-afbd-ab0f3421fec7 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:23:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:49 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:23:49 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:23:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9b866e8a-b96c-4eb7-afbd-ab0f3421fec7 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:49 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9b866e8a-b96c-4eb7-afbd-ab0f3421fec7 1073741824 Sep 25 17:23:49 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c4332fa-abfb-4daf-b035-e018256d97c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba496051-b690-4c7c-959b-3292aa3c9a4c', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cceaea86-db45-4669-86e6-7550d3c3d339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:49 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Volume volume-ba496051-b690-4c7c-959b-3292aa3c9a4c (ba496051-b690-4c7c-959b-3292aa3c9a4c): created successfully Sep 25 17:23:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cceaea86-db45-4669-86e6-7550d3c3d339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:49 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Flow 'volume_create_manager' (7e923aa6-9fdc-42f4-a9ea-70df0d1fca5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:23:49 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-8ec8029b-a6f7-4707-93be-645a79ef4e8b tempest-CreateVolumesFromImageTest-221076571 None] Created volume successfully. Sep 25 17:23:49 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9b866e8a-b96c-4eb7-afbd-ab0f3421fec7 1073741824" returned: 0 in 0.602s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9b866e8a-b96c-4eb7-afbd-ab0f3421fec7 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:50 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9b866e8a-b96c-4eb7-afbd-ab0f3421fec7 Sep 25 17:23:50 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:50 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9b866e8a-b96c-4eb7-afbd-ab0f3421fec7" returned: 0 in 0.279s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:23:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.191s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1293570912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9e2e81-70a0-49da-8b7a-d5cc1d45a606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8bf4f8526894b97842929251fb2cbeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:47Z,use_quota=True,user_id='6962edf72af04befa09ff582cdfbcb3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:23:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Creating volume 5f9e2e81-70a0-49da-8b7a-d5cc1d45a606 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:23:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:23:50 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:23:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5f9e2e81-70a0-49da-8b7a-d5cc1d45a606 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a6abde8-08a1-4fc2-a41c-c8455a72bdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b866e8a-b96c-4eb7-afbd-ab0f3421fec7', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e306e6-b5b4-422e-bbff-cb9ad4a8f1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:50 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Volume volume-9b866e8a-b96c-4eb7-afbd-ab0f3421fec7 (9b866e8a-b96c-4eb7-afbd-ab0f3421fec7): created successfully Sep 25 17:23:50 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5f9e2e81-70a0-49da-8b7a-d5cc1d45a606 1073741824 Sep 25 17:23:50 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e306e6-b5b4-422e-bbff-cb9ad4a8f1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Flow 'volume_create_manager' (e28eaa3b-7041-4423-ae29-8a99fb305323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:23:50 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-a2022ac4-fe41-40eb-9e47-a2b836305ff7 tempest-CreateVolumesFromImageTest-221076571 None] Created volume successfully. Sep 25 17:23:50 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:23:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Flow 'volume_create_manager' (de119aea-ef18-4a20-b38f-e8444a4284a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:23:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0631fa98-e208-4d6a-97bc-46cf08f0d074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0631fa98-e208-4d6a-97bc-46cf08f0d074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cfc0881-944d-42a5-9b6b-336cd4623385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a3caceaa0674651964c6840fdfc8098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:51Z,use_quota=True,user_id='502e8d5ba3e2426f8fbaf759715b8980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df84be1c-de36-487e-bbd8-af5350293864),volume_type_id=df84be1c-de36-487e-bbd8-af5350293864)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:50 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf61188-d3b8-44d5-ad10-7063e7060287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf61188-d3b8-44d5-ad10-7063e7060287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd72fa6b-fc7a-49cb-9b7c-ea01b3c754a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG cinder.image.glance [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Creating Keystone auth plugin from conf {{(pid=87211) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 17:23:51 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5f9e2e81-70a0-49da-8b7a-d5cc1d45a606 1073741824" returned: 0 in 0.720s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5f9e2e81-70a0-49da-8b7a-d5cc1d45a606 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:51 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5f9e2e81-70a0-49da-8b7a-d5cc1d45a606 Sep 25 17:23:51 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:51 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5f9e2e81-70a0-49da-8b7a-d5cc1d45a606" returned: 0 in 0.334s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-398d7e88-4b0f-49ff-bd7a-09b717c51d41 tempest-VolumeDependencyTests-2109449245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.695s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262fdf3a-1157-4905-8f3e-c202b17df346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f9e2e81-70a0-49da-8b7a-d5cc1d45a606', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e98490-d959-4a45-af97-273833f592c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-398d7e88-4b0f-49ff-bd7a-09b717c51d41 tempest-VolumeDependencyTests-2109449245 None] Creating offline snapshot 1a81452e-5d77-4a8e-9029-8b059b183499 of volume bd66abda-1485-4902-9f60-838b9d783449 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:23:51 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Volume volume-5f9e2e81-70a0-49da-8b7a-d5cc1d45a606 (5f9e2e81-70a0-49da-8b7a-d5cc1d45a606): created successfully Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e98490-d959-4a45-af97-273833f592c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Flow 'volume_create_manager' (16643715-f07c-4d28-8340-80e9cbaccc0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b630f7c8-939c-4c46-acba-dd5dfa6266d6]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-398d7e88-4b0f-49ff-bd7a-09b717c51d41 tempest-VolumeDependencyTests-2109449245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:51 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-9081a2b0-ef4d-4a50-b44f-d3a0cb89d0e0 tempest-CreateVolumesFromImageTest-221076571 None] Created volume successfully. Sep 25 17:23:51 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449 Sep 25 17:23:51 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd72fa6b-fc7a-49cb-9b7c-ea01b3c754a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0cfc0881-944d-42a5-9b6b-336cd4623385', 'volume_name': 'volume-0cfc0881-944d-42a5-9b6b-336cd4623385', 'volume_size': 1, 'image_id': 'fe96fac1-2a36-4575-a769-76473758b130', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe96fac1-2a36-4575-a769-76473758b130', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8d9a4c0d346daebaa6122d83cc2a69ef', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a3caceaa0674651964c6840fdfc8098', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35c682666b39157a0b99d6726fab1b454e46f76c35afc0fa2e85b6e03d201955f2e67b68f533a4ce40af7c7be8be23f05792f6cf28cd463ce9283f5e3edf8c00', 'id': 'fe96fac1-2a36-4575-a769-76473758b130', 'created_at': datetime.datetime(2026, 9, 25, 15, 23, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 23, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe96fac1-2a36-4575-a769-76473758b130/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0d9f4f-48dc-414c-a50f-33eb0823baf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0d9f4f-48dc-414c-a50f-33eb0823baf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7116e538-ca04-4bd7-be6e-018e32c1ca91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:51 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Volume 0cfc0881-944d-42a5-9b6b-336cd4623385: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0cfc0881-944d-42a5-9b6b-336cd4623385', 'volume_size': 1, 'image_id': 'fe96fac1-2a36-4575-a769-76473758b130', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe96fac1-2a36-4575-a769-76473758b130', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8d9a4c0d346daebaa6122d83cc2a69ef', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a3caceaa0674651964c6840fdfc8098', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35c682666b39157a0b99d6726fab1b454e46f76c35afc0fa2e85b6e03d201955f2e67b68f533a4ce40af7c7be8be23f05792f6cf28cd463ce9283f5e3edf8c00', 'id': 'fe96fac1-2a36-4575-a769-76473758b130', 'created_at': datetime.datetime(2026, 9, 25, 15, 23, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 23, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe96fac1-2a36-4575-a769-76473758b130/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Trying to clone 0cfc0881-944d-42a5-9b6b-336cd4623385 from image fe96fac1-2a36-4575-a769-76473758b130 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fe96fac1-2a36-4575-a769-76473758b130', 'metadata': {}}]). {{(pid=87211) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-12856246-c8f5-4f5c-bfc7-0457e33c361b tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "cinder-5f9e2e81-70a0-49da-8b7a-d5cc1d45a606-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-12856246-c8f5-4f5c-bfc7-0457e33c361b tempest-CreateVolumesFromImageTest-221076571 None] Lock "cinder-5f9e2e81-70a0-49da-8b7a-d5cc1d45a606-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:52 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-12856246-c8f5-4f5c-bfc7-0457e33c361b tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "cinder-quobyte-5f9e2e81-70a0-49da-8b7a-d5cc1d45a606" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:52 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 17:23:52 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Image download 0.00 MB at 0.00 MB/s Sep 25 17:23:52 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-12856246-c8f5-4f5c-bfc7-0457e33c361b tempest-CreateVolumesFromImageTest-221076571 None] Lock "cinder-quobyte-5f9e2e81-70a0-49da-8b7a-d5cc1d45a606" acquired by "delete_volume" :: waited 0.035s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:52 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:52 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee41c80-bbd8-4f08-8696-66fd7f5b13d7]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-398d7e88-4b0f-49ff-bd7a-09b717c51d41 tempest-VolumeDependencyTests-2109449245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449" returned: 0 in 0.604s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-12856246-c8f5-4f5c-bfc7-0457e33c361b tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5f9e2e81-70a0-49da-8b7a-d5cc1d45a606 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-398d7e88-4b0f-49ff-bd7a-09b717c51d41 tempest-VolumeDependencyTests-2109449245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:52 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dd3d7e-ac95-4025-9a86-2027abf1c873]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:52 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499 1G Sep 25 17:23:52 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:52 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5f9e2e81-70a0-49da-8b7a-d5cc1d45a606 Sep 25 17:23:52 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:52 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD Sep 25 17:23:52 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:52 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-12856246-c8f5-4f5c-bfc7-0457e33c361b tempest-CreateVolumesFromImageTest-221076571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5f9e2e81-70a0-49da-8b7a-d5cc1d45a606" returned: 0 in 0.443s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-12856246-c8f5-4f5c-bfc7-0457e33c361b tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5f9e2e81-70a0-49da-8b7a-d5cc1d45a606 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:52 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5f9e2e81-70a0-49da-8b7a-d5cc1d45a606 Sep 25 17:23:52 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:52 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD" returned: 0 in 0.496s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:52 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-398d7e88-4b0f-49ff-bd7a-09b717c51d41 tempest-VolumeDependencyTests-2109449245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499 1G" returned: 0 in 0.558s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-398d7e88-4b0f-49ff-bd7a-09b717c51d41 tempest-VolumeDependencyTests-2109449245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd66abda-1485-4902-9f60-838b9d783449 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:52 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd66abda-1485-4902-9f60-838b9d783449 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499 Sep 25 17:23:52 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:52 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD Sep 25 17:23:52 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:52 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-12856246-c8f5-4f5c-bfc7-0457e33c361b tempest-CreateVolumesFromImageTest-221076571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5f9e2e81-70a0-49da-8b7a-d5cc1d45a606" returned: 0 in 0.319s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:52 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-12856246-c8f5-4f5c-bfc7-0457e33c361b tempest-CreateVolumesFromImageTest-221076571 None] Lock "cinder-quobyte-5f9e2e81-70a0-49da-8b7a-d5cc1d45a606" released by "delete_volume" :: held 0.838s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-12856246-c8f5-4f5c-bfc7-0457e33c361b tempest-CreateVolumesFromImageTest-221076571 None] Created reservations ['828919a7-4697-440e-84ed-20491bb52ea5', 'fde100b2-97cc-4e36-8c8a-15d97f7ef3a2', 'e7f7c3a1-eb0c-42b6-89e7-4ce7eb45a353', '65f96e89-b556-4626-8086-7612a6a7f534'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-12856246-c8f5-4f5c-bfc7-0457e33c361b tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-12856246-c8f5-4f5c-bfc7-0457e33c361b tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-12856246-c8f5-4f5c-bfc7-0457e33c361b tempest-CreateVolumesFromImageTest-221076571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-12856246-c8f5-4f5c-bfc7-0457e33c361b tempest-CreateVolumesFromImageTest-221076571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-12856246-c8f5-4f5c-bfc7-0457e33c361b tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-12856246-c8f5-4f5c-bfc7-0457e33c361b tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:53 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:53 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD" returned: 1 in 0.564s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-398d7e88-4b0f-49ff-bd7a-09b717c51d41 tempest-VolumeDependencyTests-2109449245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd66abda-1485-4902-9f60-838b9d783449 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499" returned: 0 in 0.529s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Temporary image fe96fac1-2a36-4575-a769-76473758b130 is fetched for user 502e8d5ba3e2426f8fbaf759715b8980. {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 17:23:53 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-398d7e88-4b0f-49ff-bd7a-09b717c51d41 tempest-VolumeDependencyTests-2109449245 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499 is being set with open permissions: ugo+rw Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-398d7e88-4b0f-49ff-bd7a-09b717c51d41 tempest-VolumeDependencyTests-2109449245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:53 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:23:53 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:53 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499 Sep 25 17:23:53 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e70468ac-fd03-41f4-a4a3-98d0d7beb0f5 tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "cinder-9b866e8a-b96c-4eb7-afbd-ab0f3421fec7-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e70468ac-fd03-41f4-a4a3-98d0d7beb0f5 tempest-CreateVolumesFromImageTest-221076571 None] Lock "cinder-9b866e8a-b96c-4eb7-afbd-ab0f3421fec7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e70468ac-fd03-41f4-a4a3-98d0d7beb0f5 tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "cinder-quobyte-9b866e8a-b96c-4eb7-afbd-ab0f3421fec7" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[01faf1aa-d67c-413f-b94d-c6b6c622bbee]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e70468ac-fd03-41f4-a4a3-98d0d7beb0f5 tempest-CreateVolumesFromImageTest-221076571 None] Lock "cinder-quobyte-9b866e8a-b96c-4eb7-afbd-ab0f3421fec7" acquired by "delete_volume" :: waited 0.076s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae08c24-80e6-4fe5-b717-74ae0e0bbcf6]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e70468ac-fd03-41f4-a4a3-98d0d7beb0f5 tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9b866e8a-b96c-4eb7-afbd-ab0f3421fec7 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:53 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-12856246-c8f5-4f5c-bfc7-0457e33c361b tempest-CreateVolumesFromImageTest-221076571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.415s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-12856246-c8f5-4f5c-bfc7-0457e33c361b tempest-CreateVolumesFromImageTest-221076571 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:23:53 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-12856246-c8f5-4f5c-bfc7-0457e33c361b tempest-CreateVolumesFromImageTest-221076571 None] Deleted volume successfully. Sep 25 17:23:53 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD Sep 25 17:23:53 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-12856246-c8f5-4f5c-bfc7-0457e33c361b tempest-CreateVolumesFromImageTest-221076571 None] Lock "cinder-5f9e2e81-70a0-49da-8b7a-d5cc1d45a606-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:53 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:23:53 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:53 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-398d7e88-4b0f-49ff-bd7a-09b717c51d41 tempest-VolumeDependencyTests-2109449245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499" returned: 0 in 0.548s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:53 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9b866e8a-b96c-4eb7-afbd-ab0f3421fec7 Sep 25 17:23:53 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-398d7e88-4b0f-49ff-bd7a-09b717c51d41 tempest-VolumeDependencyTests-2109449245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:53 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.info Sep 25 17:23:53 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:54 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD" returned: 0 in 0.559s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:54 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.407s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 28 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:23:54 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e70468ac-fd03-41f4-a4a3-98d0d7beb0f5 tempest-CreateVolumesFromImageTest-221076571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9b866e8a-b96c-4eb7-afbd-ab0f3421fec7" returned: 0 in 0.679s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e70468ac-fd03-41f4-a4a3-98d0d7beb0f5 tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9b866e8a-b96c-4eb7-afbd-ab0f3421fec7 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:54 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD Sep 25 17:23:54 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:54 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9b866e8a-b96c-4eb7-afbd-ab0f3421fec7 Sep 25 17:23:54 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:54 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-398d7e88-4b0f-49ff-bd7a-09b717c51d41 tempest-VolumeDependencyTests-2109449245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.info" returned: 0 in 0.426s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:54 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-398d7e88-4b0f-49ff-bd7a-09b717c51d41 tempest-VolumeDependencyTests-2109449245 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.info is being set with open permissions: ugo+rw Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-398d7e88-4b0f-49ff-bd7a-09b717c51d41 tempest-VolumeDependencyTests-2109449245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:54 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.info Sep 25 17:23:54 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:54 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD" returned: 1 in 0.495s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:54 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e70468ac-fd03-41f4-a4a3-98d0d7beb0f5 tempest-CreateVolumesFromImageTest-221076571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-9b866e8a-b96c-4eb7-afbd-ab0f3421fec7" returned: 0 in 0.358s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e70468ac-fd03-41f4-a4a3-98d0d7beb0f5 tempest-CreateVolumesFromImageTest-221076571 None] Lock "cinder-quobyte-9b866e8a-b96c-4eb7-afbd-ab0f3421fec7" released by "delete_volume" :: held 1.108s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:54 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-e70468ac-fd03-41f4-a4a3-98d0d7beb0f5 tempest-CreateVolumesFromImageTest-221076571 None] Created reservations ['293dfd2e-0517-476e-89e3-09c22eb105c1', 'ab1a785b-6cd4-441a-9d2a-287743b2a4ab', '8bb292ce-0a2d-464e-9465-2ef83dd29eff', 'd03c679d-c8d2-4a14-8faa-e72aab848fcc'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-398d7e88-4b0f-49ff-bd7a-09b717c51d41 tempest-VolumeDependencyTests-2109449245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.info" returned: 0 in 0.389s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-398d7e88-4b0f-49ff-bd7a-09b717c51d41 tempest-VolumeDependencyTests-2109449245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.277s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.163s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cfc0881-944d-42a5-9b6b-336cd4623385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a3caceaa0674651964c6840fdfc8098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:51Z,use_quota=True,user_id='502e8d5ba3e2426f8fbaf759715b8980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df84be1c-de36-487e-bbd8-af5350293864),volume_type_id=df84be1c-de36-487e-bbd8-af5350293864)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Creating volume 0cfc0881-944d-42a5-9b6b-336cd4623385 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:23:54 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0cfc0881-944d-42a5-9b6b-336cd4623385 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:54 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0cfc0881-944d-42a5-9b6b-336cd4623385 1073741824 Sep 25 17:23:54 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:54 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-398d7e88-4b0f-49ff-bd7a-09b717c51d41 tempest-VolumeDependencyTests-2109449245 None] Create snapshot completed successfully Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e70468ac-fd03-41f4-a4a3-98d0d7beb0f5 tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e70468ac-fd03-41f4-a4a3-98d0d7beb0f5 tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e70468ac-fd03-41f4-a4a3-98d0d7beb0f5 tempest-CreateVolumesFromImageTest-221076571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e70468ac-fd03-41f4-a4a3-98d0d7beb0f5 tempest-CreateVolumesFromImageTest-221076571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e70468ac-fd03-41f4-a4a3-98d0d7beb0f5 tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e70468ac-fd03-41f4-a4a3-98d0d7beb0f5 tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:54 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:23:54 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:55 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e70468ac-fd03-41f4-a4a3-98d0d7beb0f5 tempest-CreateVolumesFromImageTest-221076571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.374s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:55 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-e70468ac-fd03-41f4-a4a3-98d0d7beb0f5 tempest-CreateVolumesFromImageTest-221076571 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:23:55 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-e70468ac-fd03-41f4-a4a3-98d0d7beb0f5 tempest-CreateVolumesFromImageTest-221076571 None] Deleted volume successfully. Sep 25 17:23:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e70468ac-fd03-41f4-a4a3-98d0d7beb0f5 tempest-CreateVolumesFromImageTest-221076571 None] Lock "cinder-9b866e8a-b96c-4eb7-afbd-ab0f3421fec7-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:55 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0cfc0881-944d-42a5-9b6b-336cd4623385 1073741824" returned: 0 in 0.656s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:55 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0cfc0881-944d-42a5-9b6b-336cd4623385 Sep 25 17:23:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0cfc0881-944d-42a5-9b6b-336cd4623385 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:55 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:55 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0cfc0881-944d-42a5-9b6b-336cd4623385" returned: 0 in 0.382s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:23:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6afc0e83-862e-44da-8748-35f3e2c46bf5 tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "cinder-ba496051-b690-4c7c-959b-3292aa3c9a4c-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6afc0e83-862e-44da-8748-35f3e2c46bf5 tempest-CreateVolumesFromImageTest-221076571 None] Lock "cinder-ba496051-b690-4c7c-959b-3292aa3c9a4c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:55 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Attempting download of fe96fac1-2a36-4575-a769-76473758b130 ((None, [{'url': 'file:///opt/stack/data/glance/images/fe96fac1-2a36-4575-a769-76473758b130', 'metadata': {}}])) to volume 0cfc0881-944d-42a5-9b6b-336cd4623385. {{(pid=87211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 17:23:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6afc0e83-862e-44da-8748-35f3e2c46bf5 tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "cinder-quobyte-ba496051-b690-4c7c-959b-3292aa3c9a4c" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6afc0e83-862e-44da-8748-35f3e2c46bf5 tempest-CreateVolumesFromImageTest-221076571 None] Lock "cinder-quobyte-ba496051-b690-4c7c-959b-3292aa3c9a4c" acquired by "delete_volume" :: waited 0.061s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7f88f7-46e0-40f9-9a0f-6924b742b933]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe96fac1-2a36-4575-a769-76473758b130_ga8t5l40 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[253dd55b-d234-406a-b5f4-e81beec2c59b]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6afc0e83-862e-44da-8748-35f3e2c46bf5 tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ba496051-b690-4c7c-959b-3292aa3c9a4c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:56 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe96fac1-2a36-4575-a769-76473758b130_ga8t5l40 Sep 25 17:23:56 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:23:56 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ba496051-b690-4c7c-959b-3292aa3c9a4c Sep 25 17:23:56 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Flow 'volume_create_manager' (faa2f4e8-46a7-40ef-b26e-15a3eb2c4ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e449835-b6fb-441a-98f9-8032ec8b8e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e449835-b6fb-441a-98f9-8032ec8b8e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-602624428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ba081b-4f92-4057-9c3e-645a988fa178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74145e8a7118498aa1c24e7a89901736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1a81452e-5d77-4a8e-9029-8b059b183499,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:56Z,use_quota=True,user_id='49d420fb67b44ef3a20bbc5d49b673f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca3b99fd-dd44-4b4c-8101-0899b91b8ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca3b99fd-dd44-4b4c-8101-0899b91b8ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c552c28-d596-42c8-b2c5-3b63e397d2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c552c28-d596-42c8-b2c5-3b63e397d2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '97ba081b-4f92-4057-9c3e-645a988fa178', 'volume_name': 'volume-97ba081b-4f92-4057-9c3e-645a988fa178', 'volume_size': 1, 'snapshot_id': '1a81452e-5d77-4a8e-9029-8b059b183499'}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d505bc12-acfa-4fb6-8b19-699f94da99ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d505bc12-acfa-4fb6-8b19-699f94da99ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac78e1af-382a-4875-aa9f-622f6b15a416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:56 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Volume 97ba081b-4f92-4057-9c3e-645a988fa178: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-97ba081b-4f92-4057-9c3e-645a988fa178', 'volume_size': 1, 'snapshot_id': '1a81452e-5d77-4a8e-9029-8b059b183499'} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Acquiring lock "cinder-quobyte-1a81452e-5d77-4a8e-9029-8b059b183499-97ba081b-4f92-4057-9c3e-645a988fa178" by "_create_volume_from_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Lock "cinder-quobyte-1a81452e-5d77-4a8e-9029-8b059b183499-97ba081b-4f92-4057-9c3e-645a988fa178" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Creating volume 97ba081b-4f92-4057-9c3e-645a988fa178 from snapshot 1a81452e-5d77-4a8e-9029-8b059b183499 {{(pid=87211) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Acquiring lock "cinder-quobyte-97ba081b-4f92-4057-9c3e-645a988fa178" by "_copy_volume_from_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Lock "cinder-quobyte-97ba081b-4f92-4057-9c3e-645a988fa178" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] snapshot: 1a81452e-5d77-4a8e-9029-8b059b183499, volume: 97ba081b-4f92-4057-9c3e-645a988fa178, {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:56 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe96fac1-2a36-4575-a769-76473758b130_ga8t5l40" returned: 0 in 0.499s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe96fac1-2a36-4575-a769-76473758b130_ga8t5l40 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdb8f92-204d-478a-a847-b12a85b3ed20]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:56 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6afc0e83-862e-44da-8748-35f3e2c46bf5 tempest-CreateVolumesFromImageTest-221076571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ba496051-b690-4c7c-959b-3292aa3c9a4c" returned: 0 in 0.581s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6afc0e83-862e-44da-8748-35f3e2c46bf5 tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ba496051-b690-4c7c-959b-3292aa3c9a4c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:56 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe96fac1-2a36-4575-a769-76473758b130_ga8t5l40 Sep 25 17:23:56 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:56 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ba496051-b690-4c7c-959b-3292aa3c9a4c Sep 25 17:23:56 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499 Sep 25 17:23:56 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:56 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:56 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe96fac1-2a36-4575-a769-76473758b130_ga8t5l40" returned: 1 in 0.374s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe96fac1-2a36-4575-a769-76473758b130_ga8t5l40' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6dc6bff-b074-412e-8803-9c3d8c0087f6]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:57 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD Sep 25 17:23:57 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:57 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499" returned: 0 in 0.576s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd66abda-1485-4902-9f60-838b9d783449(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42790dd-56f8-4b8e-a9f4-f23b60f18ac6]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:57 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6afc0e83-862e-44da-8748-35f3e2c46bf5 tempest-CreateVolumesFromImageTest-221076571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ba496051-b690-4c7c-959b-3292aa3c9a4c" returned: 0 in 0.535s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6afc0e83-862e-44da-8748-35f3e2c46bf5 tempest-CreateVolumesFromImageTest-221076571 None] Lock "cinder-quobyte-ba496051-b690-4c7c-959b-3292aa3c9a4c" released by "delete_volume" :: held 1.213s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:57 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449 Sep 25 17:23:57 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-6afc0e83-862e-44da-8748-35f3e2c46bf5 tempest-CreateVolumesFromImageTest-221076571 None] Created reservations ['0fc76c1b-db67-4ae1-9f40-a78294cd36ac', '364ed1ed-ef55-41c2-b8bf-c63aab89be38', 'a282cf8c-3662-4765-8daf-b94b61644cf8', '54d68415-cfff-4e24-aae1-cbe0f6bcc8da'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:23:57 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD" returned: 0 in 0.481s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6afc0e83-862e-44da-8748-35f3e2c46bf5 tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6afc0e83-862e-44da-8748-35f3e2c46bf5 tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6afc0e83-862e-44da-8748-35f3e2c46bf5 tempest-CreateVolumesFromImageTest-221076571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6afc0e83-862e-44da-8748-35f3e2c46bf5 tempest-CreateVolumesFromImageTest-221076571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6afc0e83-862e-44da-8748-35f3e2c46bf5 tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6afc0e83-862e-44da-8748-35f3e2c46bf5 tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:57 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:23:57 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:57 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD Sep 25 17:23:57 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:57 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449" returned: 0 in 0.506s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] will copy from snapshot at /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449 {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Creating direct copy from snapshot {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG cinder.utils [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Path /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97ba081b-4f92-4057-9c3e-645a988fa178 not found in is_blk_device check {{(pid=87211) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97ba081b-4f92-4057-9c3e-645a988fa178 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:57 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97ba081b-4f92-4057-9c3e-645a988fa178 Sep 25 17:23:57 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:57 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD" returned: 1 in 0.393s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] fe96fac1-2a36-4575-a769-76473758b130 was raw, converting to qcow2 {{(pid=87211) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0cfc0881-944d-42a5-9b6b-336cd4623385 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:57 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6afc0e83-862e-44da-8748-35f3e2c46bf5 tempest-CreateVolumesFromImageTest-221076571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.371s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-6afc0e83-862e-44da-8748-35f3e2c46bf5 tempest-CreateVolumesFromImageTest-221076571 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:23:57 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0cfc0881-944d-42a5-9b6b-336cd4623385 Sep 25 17:23:57 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:57 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-6afc0e83-862e-44da-8748-35f3e2c46bf5 tempest-CreateVolumesFromImageTest-221076571 None] Deleted volume successfully. Sep 25 17:23:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6afc0e83-862e-44da-8748-35f3e2c46bf5 tempest-CreateVolumesFromImageTest-221076571 None] Lock "cinder-ba496051-b690-4c7c-959b-3292aa3c9a4c-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1a7ea87e-7b62-4d50-9395-7c90920eaff6 tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "cinder-3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1a7ea87e-7b62-4d50-9395-7c90920eaff6 tempest-CreateVolumesFromImageTest-221076571 None] Lock "cinder-3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1a7ea87e-7b62-4d50-9395-7c90920eaff6 tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "cinder-quobyte-3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:58 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1a7ea87e-7b62-4d50-9395-7c90920eaff6 tempest-CreateVolumesFromImageTest-221076571 None] Lock "cinder-quobyte-3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8" acquired by "delete_volume" :: waited 0.054s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:58 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b2425b-767b-451b-9435-1534f7deae6a]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1a7ea87e-7b62-4d50-9395-7c90920eaff6 tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:58 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8 Sep 25 17:23:58 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:58 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0cfc0881-944d-42a5-9b6b-336cd4623385" returned: 0 in 1.124s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:58 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fe96fac1-2a36-4575-a769-76473758b130_8p27dofhdevstack@QuobyteHD, size 0.00 MB, duration 1.13 sec, destination /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0cfc0881-944d-42a5-9b6b-336cd4623385 {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:23:58 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 17:23:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0cfc0881-944d-42a5-9b6b-336cd4623385 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:58 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0cfc0881-944d-42a5-9b6b-336cd4623385 1G Sep 25 17:23:58 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:59 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1a7ea87e-7b62-4d50-9395-7c90920eaff6 tempest-CreateVolumesFromImageTest-221076571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8" returned: 0 in 0.776s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1a7ea87e-7b62-4d50-9395-7c90920eaff6 tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:59 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8 Sep 25 17:23:59 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:59 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0cfc0881-944d-42a5-9b6b-336cd4623385 1G" returned: 0 in 0.876s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:59 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Downloaded image fe96fac1-2a36-4575-a769-76473758b130 ((None, [{'url': 'file:///opt/stack/data/glance/images/fe96fac1-2a36-4575-a769-76473758b130', 'metadata': {}}])) to volume 0cfc0881-944d-42a5-9b6b-336cd4623385 successfully. {{(pid=87211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 17:23:59 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Temporary image fe96fac1-2a36-4575-a769-76473758b130 for user 502e8d5ba3e2426f8fbaf759715b8980 is deleted. {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 17:23:59 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Marking volume 0cfc0881-944d-42a5-9b6b-336cd4623385 as bootable. {{(pid=87211) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 17:23:59 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:59 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Copying metadata from image fe96fac1-2a36-4575-a769-76473758b130 to 0cfc0881-944d-42a5-9b6b-336cd4623385. {{(pid=87211) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 17:23:59 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Creating volume glance metadata for volume 0cfc0881-944d-42a5-9b6b-336cd4623385 backed by image fe96fac1-2a36-4575-a769-76473758b130 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'fe96fac1-2a36-4575-a769-76473758b130', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8d9a4c0d346daebaa6122d83cc2a69ef', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87211) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 17:23:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1a7ea87e-7b62-4d50-9395-7c90920eaff6 tempest-CreateVolumesFromImageTest-221076571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8" returned: 0 in 0.557s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1a7ea87e-7b62-4d50-9395-7c90920eaff6 tempest-CreateVolumesFromImageTest-221076571 None] Lock "cinder-quobyte-3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8" released by "delete_volume" :: held 1.468s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:00 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-1a7ea87e-7b62-4d50-9395-7c90920eaff6 tempest-CreateVolumesFromImageTest-221076571 None] Created reservations ['4a30b9e4-a352-4846-b019-15ffad063fdc', '3b322cc2-702c-490e-877a-47ce0da10431', '76126fd8-da01-41bb-a1e0-04325b33bfc7', 'c3a24402-62bd-4754-9323-ce86aff298c6'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:00 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7116e538-ca04-4bd7-be6e-018e32c1ca91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cfc0881-944d-42a5-9b6b-336cd4623385', 'volume_size': 1, 'image_id': 'fe96fac1-2a36-4575-a769-76473758b130', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe96fac1-2a36-4575-a769-76473758b130', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8d9a4c0d346daebaa6122d83cc2a69ef', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a3caceaa0674651964c6840fdfc8098', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35c682666b39157a0b99d6726fab1b454e46f76c35afc0fa2e85b6e03d201955f2e67b68f533a4ce40af7c7be8be23f05792f6cf28cd463ce9283f5e3edf8c00', 'id': 'fe96fac1-2a36-4575-a769-76473758b130', 'created_at': datetime.datetime(2026, 9, 25, 15, 23, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 23, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe96fac1-2a36-4575-a769-76473758b130/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:00 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f190d1fa-ef41-4645-b2ee-e7b5e7c8a851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:00 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Volume volume-0cfc0881-944d-42a5-9b6b-336cd4623385 (0cfc0881-944d-42a5-9b6b-336cd4623385): created successfully Sep 25 17:24:00 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f190d1fa-ef41-4645-b2ee-e7b5e7c8a851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:00 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Flow 'volume_create_manager' (de119aea-ef18-4a20-b38f-e8444a4284a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:00 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b2780548-9f7a-4efe-8625-e42a22daafde tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Created volume successfully. Sep 25 17:24:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1a7ea87e-7b62-4d50-9395-7c90920eaff6 tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1a7ea87e-7b62-4d50-9395-7c90920eaff6 tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:00 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1a7ea87e-7b62-4d50-9395-7c90920eaff6 tempest-CreateVolumesFromImageTest-221076571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:00 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1a7ea87e-7b62-4d50-9395-7c90920eaff6 tempest-CreateVolumesFromImageTest-221076571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1a7ea87e-7b62-4d50-9395-7c90920eaff6 tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1a7ea87e-7b62-4d50-9395-7c90920eaff6 tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:00 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:00 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:00 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1a7ea87e-7b62-4d50-9395-7c90920eaff6 tempest-CreateVolumesFromImageTest-221076571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.571s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:00 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-1a7ea87e-7b62-4d50-9395-7c90920eaff6 tempest-CreateVolumesFromImageTest-221076571 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:00 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-1a7ea87e-7b62-4d50-9395-7c90920eaff6 tempest-CreateVolumesFromImageTest-221076571 None] Deleted volume successfully. Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8da56e13-edcf-4fa8-a021-e4649e84bef3 tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "cinder-df2c51c4-b2b0-4233-b17d-c465b2a699c4-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1a7ea87e-7b62-4d50-9395-7c90920eaff6 tempest-CreateVolumesFromImageTest-221076571 None] Lock "cinder-3aaa4679-4f5f-4f6c-9d03-efc5eedd4aa8-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8da56e13-edcf-4fa8-a021-e4649e84bef3 tempest-CreateVolumesFromImageTest-221076571 None] Lock "cinder-df2c51c4-b2b0-4233-b17d-c465b2a699c4-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8da56e13-edcf-4fa8-a021-e4649e84bef3 tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "cinder-quobyte-df2c51c4-b2b0-4233-b17d-c465b2a699c4" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Flow 'volume_create_manager' (905cf3e9-d0a2-458b-968d-82df3085c10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db190b38-db32-4fcb-9f81-b2e3da52bdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8da56e13-edcf-4fa8-a021-e4649e84bef3 tempest-CreateVolumesFromImageTest-221076571 None] Lock "cinder-quobyte-df2c51c4-b2b0-4233-b17d-c465b2a699c4" acquired by "delete_volume" :: waited 0.129s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-afb1955f-8ad9-43a2-a1ee-a0110be9b786 tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Acquiring lock "cinder-0cfc0881-944d-42a5-9b6b-336cd4623385-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db190b38-db32-4fcb-9f81-b2e3da52bdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-930680627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a9728775254468a03d6b90bc00069d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:01Z,use_quota=True,user_id='19c5d266957c4aa994c1c274ce094045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0741a96f-6795-4cff-8a7f-c4f8bbb29ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0741a96f-6795-4cff-8a7f-c4f8bbb29ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72cbccd-0299-4992-aa8f-45c45da922cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72cbccd-0299-4992-aa8f-45c45da922cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4', 'volume_name': 'volume-d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063d3bad-6c15-4940-9d28-c641acaa6a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063d3bad-6c15-4940-9d28-c641acaa6a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da24db60-c0af-4732-8948-7b092b59adcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:01 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Volume d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4', 'volume_size': 1} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0b2654-ea49-4d3e-83c1-513812b6e0be]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8da56e13-edcf-4fa8-a021-e4649e84bef3 tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-df2c51c4-b2b0-4233-b17d-c465b2a699c4 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-afb1955f-8ad9-43a2-a1ee-a0110be9b786 tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Lock "cinder-0cfc0881-944d-42a5-9b6b-336cd4623385-delete_volume" acquired by "delete_volume" :: waited 0.149s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-afb1955f-8ad9-43a2-a1ee-a0110be9b786 tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Acquiring lock "cinder-quobyte-0cfc0881-944d-42a5-9b6b-336cd4623385" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-afb1955f-8ad9-43a2-a1ee-a0110be9b786 tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Lock "cinder-quobyte-0cfc0881-944d-42a5-9b6b-336cd4623385" acquired by "delete_volume" :: waited 0.029s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e733ec-d4c4-4f9b-9b23-faa8268e29d2]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-afb1955f-8ad9-43a2-a1ee-a0110be9b786 tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0cfc0881-944d-42a5-9b6b-336cd4623385 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:01 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-df2c51c4-b2b0-4233-b17d-c465b2a699c4 Sep 25 17:24:01 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:01 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0cfc0881-944d-42a5-9b6b-336cd4623385 Sep 25 17:24:01 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:02 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8da56e13-edcf-4fa8-a021-e4649e84bef3 tempest-CreateVolumesFromImageTest-221076571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-df2c51c4-b2b0-4233-b17d-c465b2a699c4" returned: 0 in 0.800s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8da56e13-edcf-4fa8-a021-e4649e84bef3 tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-df2c51c4-b2b0-4233-b17d-c465b2a699c4 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:02 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-df2c51c4-b2b0-4233-b17d-c465b2a699c4 Sep 25 17:24:02 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:02 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-afb1955f-8ad9-43a2-a1ee-a0110be9b786 tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0cfc0881-944d-42a5-9b6b-336cd4623385" returned: 0 in 0.731s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-afb1955f-8ad9-43a2-a1ee-a0110be9b786 tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0cfc0881-944d-42a5-9b6b-336cd4623385 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:02 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0cfc0881-944d-42a5-9b6b-336cd4623385 Sep 25 17:24:02 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:02 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8da56e13-edcf-4fa8-a021-e4649e84bef3 tempest-CreateVolumesFromImageTest-221076571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-df2c51c4-b2b0-4233-b17d-c465b2a699c4" returned: 0 in 0.542s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:02 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8da56e13-edcf-4fa8-a021-e4649e84bef3 tempest-CreateVolumesFromImageTest-221076571 None] Lock "cinder-quobyte-df2c51c4-b2b0-4233-b17d-c465b2a699c4" released by "delete_volume" :: held 1.551s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:02 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-afb1955f-8ad9-43a2-a1ee-a0110be9b786 tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0cfc0881-944d-42a5-9b6b-336cd4623385" returned: 0 in 0.470s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:02 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-afb1955f-8ad9-43a2-a1ee-a0110be9b786 tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Lock "cinder-quobyte-0cfc0881-944d-42a5-9b6b-336cd4623385" released by "delete_volume" :: held 1.293s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:03 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-8da56e13-edcf-4fa8-a021-e4649e84bef3 tempest-CreateVolumesFromImageTest-221076571 None] Created reservations ['a438e78d-cf4b-4647-a8ad-b6620d4a4ce8', 'a1af4754-2030-476c-9ba2-c46a2583a5e7', '1ba1591d-e2f1-4ee7-ae97-ef50298f310b', '5e1aa8f3-4e7b-4d63-92d7-bca2aaccbb52'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:03 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-afb1955f-8ad9-43a2-a1ee-a0110be9b786 tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Created reservations ['66746735-9f30-4d8d-91c9-ede7360b6459', '028123db-ccc1-4ef4-8a79-b468b468028e', '392c3795-205a-4786-a0f0-2c8dd4ea5810', '4c931480-7202-4e54-b418-76cd2a0c1964'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8da56e13-edcf-4fa8-a021-e4649e84bef3 tempest-CreateVolumesFromImageTest-221076571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8da56e13-edcf-4fa8-a021-e4649e84bef3 tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8da56e13-edcf-4fa8-a021-e4649e84bef3 tempest-CreateVolumesFromImageTest-221076571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8da56e13-edcf-4fa8-a021-e4649e84bef3 tempest-CreateVolumesFromImageTest-221076571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8da56e13-edcf-4fa8-a021-e4649e84bef3 tempest-CreateVolumesFromImageTest-221076571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8da56e13-edcf-4fa8-a021-e4649e84bef3 tempest-CreateVolumesFromImageTest-221076571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:03 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:03 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-afb1955f-8ad9-43a2-a1ee-a0110be9b786 tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-afb1955f-8ad9-43a2-a1ee-a0110be9b786 tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-afb1955f-8ad9-43a2-a1ee-a0110be9b786 tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-afb1955f-8ad9-43a2-a1ee-a0110be9b786 tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-afb1955f-8ad9-43a2-a1ee-a0110be9b786 tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-afb1955f-8ad9-43a2-a1ee-a0110be9b786 tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:03 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:03 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:03 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8da56e13-edcf-4fa8-a021-e4649e84bef3 tempest-CreateVolumesFromImageTest-221076571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.532s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:03 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-8da56e13-edcf-4fa8-a021-e4649e84bef3 tempest-CreateVolumesFromImageTest-221076571 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:03 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-8da56e13-edcf-4fa8-a021-e4649e84bef3 tempest-CreateVolumesFromImageTest-221076571 None] Deleted volume successfully. Sep 25 17:24:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8da56e13-edcf-4fa8-a021-e4649e84bef3 tempest-CreateVolumesFromImageTest-221076571 None] Lock "cinder-df2c51c4-b2b0-4233-b17d-c465b2a699c4-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:03 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-afb1955f-8ad9-43a2-a1ee-a0110be9b786 tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.574s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:03 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-afb1955f-8ad9-43a2-a1ee-a0110be9b786 tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:03 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-afb1955f-8ad9-43a2-a1ee-a0110be9b786 tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Deleted volume successfully. Sep 25 17:24:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-afb1955f-8ad9-43a2-a1ee-a0110be9b786 tempest-VolumeAndVolumeTypeFromImageTest-1121724132 None] Lock "cinder-0cfc0881-944d-42a5-9b6b-336cd4623385-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:06 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97ba081b-4f92-4057-9c3e-645a988fa178" returned: 0 in 8.603s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:06 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Image conversion details: src /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449, size 1024.00 MB, duration 8.60 sec, destination /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97ba081b-4f92-4057-9c3e-645a988fa178 {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:24:06 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Converted 1024.00 MB image at 119.02 MB/s Sep 25 17:24:06 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97ba081b-4f92-4057-9c3e-645a988fa178 is being set with open permissions: ugo+rw Sep 25 17:24:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97ba081b-4f92-4057-9c3e-645a988fa178 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:06 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97ba081b-4f92-4057-9c3e-645a988fa178 Sep 25 17:24:06 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:06 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97ba081b-4f92-4057-9c3e-645a988fa178" returned: 0 in 0.283s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:06 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Lock "cinder-quobyte-97ba081b-4f92-4057-9c3e-645a988fa178" released by "_copy_volume_from_snapshot" :: held 10.114s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:06 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Lock "cinder-quobyte-1a81452e-5d77-4a8e-9029-8b059b183499-97ba081b-4f92-4057-9c3e-645a988fa178" released by "_create_volume_from_snapshot" :: held 10.191s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.210s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.094s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-930680627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a9728775254468a03d6b90bc00069d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:01Z,use_quota=True,user_id='19c5d266957c4aa994c1c274ce094045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Creating volume d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:06 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:06 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4 1073741824 Sep 25 17:24:06 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac78e1af-382a-4875-aa9f-622f6b15a416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ba081b-4f92-4057-9c3e-645a988fa178', 'volume_size': 1, 'snapshot_id': '1a81452e-5d77-4a8e-9029-8b059b183499'}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74c5f19-bc5a-4bc2-8a3f-7f2703ef3848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:06 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Volume volume-97ba081b-4f92-4057-9c3e-645a988fa178 (97ba081b-4f92-4057-9c3e-645a988fa178): created successfully Sep 25 17:24:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74c5f19-bc5a-4bc2-8a3f-7f2703ef3848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Flow 'volume_create_manager' (faa2f4e8-46a7-40ef-b26e-15a3eb2c4ef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:06 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-99d23e48-9a14-4020-8a6b-d4f51a5bba0c tempest-VolumeDependencyTests-2109449245 None] Created volume successfully. Sep 25 17:24:07 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4 1073741824" returned: 0 in 0.592s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-37af17b9-d05b-4be4-a4fd-491af44c427f tempest-VolumeDependencyTests-2109449245 None] Acquiring lock "cinder-1a81452e-5d77-4a8e-9029-8b059b183499-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-37af17b9-d05b-4be4-a4fd-491af44c427f tempest-VolumeDependencyTests-2109449245 None] Lock "cinder-1a81452e-5d77-4a8e-9029-8b059b183499-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-37af17b9-d05b-4be4-a4fd-491af44c427f tempest-VolumeDependencyTests-2109449245 None] Acquiring lock "cinder-quobyte-bd66abda-1485-4902-9f60-838b9d783449" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:07 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4 Sep 25 17:24:07 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-37af17b9-d05b-4be4-a4fd-491af44c427f tempest-VolumeDependencyTests-2109449245 None] Lock "cinder-quobyte-bd66abda-1485-4902-9f60-838b9d783449" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-37af17b9-d05b-4be4-a4fd-491af44c427f tempest-VolumeDependencyTests-2109449245 None] Acquiring lock "cinder-quobyte-1a81452e-5d77-4a8e-9029-8b059b183499" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:07 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-37af17b9-d05b-4be4-a4fd-491af44c427f tempest-VolumeDependencyTests-2109449245 None] Lock "cinder-quobyte-1a81452e-5d77-4a8e-9029-8b059b183499" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-37af17b9-d05b-4be4-a4fd-491af44c427f tempest-VolumeDependencyTests-2109449245 None] Deleting offline snapshot 1a81452e-5d77-4a8e-9029-8b059b183499 of volume bd66abda-1485-4902-9f60-838b9d783449 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:24:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-37af17b9-d05b-4be4-a4fd-491af44c427f tempest-VolumeDependencyTests-2109449245 None] snapshot_file for this snap is: volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:24:07 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[413e8a2c-047b-4b99-b0af-204bc87339f5]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-37af17b9-d05b-4be4-a4fd-491af44c427f tempest-VolumeDependencyTests-2109449245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:07 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499 Sep 25 17:24:07 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:07 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4" returned: 0 in 0.350s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da24db60-c0af-4732-8948-7b092b59adcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e188f25-f917-47d6-970f-9dfd0a7735c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:07 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Volume volume-d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4 (d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4): created successfully Sep 25 17:24:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e188f25-f917-47d6-970f-9dfd0a7735c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:07 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Flow 'volume_create_manager' (905cf3e9-d0a2-458b-968d-82df3085c10c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:07 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-93097b0b-c34e-4ab8-9963-6774da34db0e tempest-ProjectReaderTests-330204430 None] Created volume successfully. Sep 25 17:24:08 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-37af17b9-d05b-4be4-a4fd-491af44c427f tempest-VolumeDependencyTests-2109449245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499" returned: 0 in 0.594s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-37af17b9-d05b-4be4-a4fd-491af44c427f tempest-VolumeDependencyTests-2109449245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd66abda-1485-4902-9f60-838b9d783449(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5add37a5-4660-46a6-b196-6a02cc246406]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-37af17b9-d05b-4be4-a4fd-491af44c427f tempest-VolumeDependencyTests-2109449245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:08 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449 Sep 25 17:24:08 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4eee372f-ec1e-4b45-bac7-c2fc0f1c9f26 tempest-ProjectReaderTests-330204430 None] Acquiring lock "cinder-d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4eee372f-ec1e-4b45-bac7-c2fc0f1c9f26 tempest-ProjectReaderTests-330204430 None] Lock "cinder-d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4eee372f-ec1e-4b45-bac7-c2fc0f1c9f26 tempest-ProjectReaderTests-330204430 None] Acquiring lock "cinder-quobyte-d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4eee372f-ec1e-4b45-bac7-c2fc0f1c9f26 tempest-ProjectReaderTests-330204430 None] Lock "cinder-quobyte-d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4" acquired by "delete_volume" :: waited 0.028s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c0f09e-752c-4fa1-853c-28b5267816e8]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4eee372f-ec1e-4b45-bac7-c2fc0f1c9f26 tempest-ProjectReaderTests-330204430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:08 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4 Sep 25 17:24:08 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Flow 'volume_create_manager' (69024744-069e-4418-9625-e99fa27967d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7b6baf-45ff-4204-ac5a-fb48ca33550a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7b6baf-45ff-4204-ac5a-fb48ca33550a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2054002929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29632c25-89e3-4edd-92fb-e25fde51bb2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b8a542aaf842a6bb50594d57f8fd78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:09Z,use_quota=True,user_id='b740ac554694435ebc3baf8b86d0f6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa332167-e42f-4e9a-93bf-8732145f8c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa332167-e42f-4e9a-93bf-8732145f8c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3d3c90-50ae-458d-b60f-30d375dd8fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3d3c90-50ae-458d-b60f-30d375dd8fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29632c25-89e3-4edd-92fb-e25fde51bb2e', 'volume_name': 'volume-29632c25-89e3-4edd-92fb-e25fde51bb2e', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc95b502-952b-48bf-9140-f13e4cd6e6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc95b502-952b-48bf-9140-f13e4cd6e6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd2d4db-d11a-4dd9-805f-3bac8d3b3521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:08 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Volume 29632c25-89e3-4edd-92fb-e25fde51bb2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29632c25-89e3-4edd-92fb-e25fde51bb2e', 'volume_size': 1} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2054002929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29632c25-89e3-4edd-92fb-e25fde51bb2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b8a542aaf842a6bb50594d57f8fd78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:09Z,use_quota=True,user_id='b740ac554694435ebc3baf8b86d0f6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Creating volume 29632c25-89e3-4edd-92fb-e25fde51bb2e {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:08 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:08 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e 1073741824 Sep 25 17:24:08 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:08 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-37af17b9-d05b-4be4-a4fd-491af44c427f tempest-VolumeDependencyTests-2109449245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449" returned: 0 in 0.844s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-37af17b9-d05b-4be4-a4fd-491af44c427f tempest-VolumeDependencyTests-2109449245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:08 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499 Sep 25 17:24:08 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:08 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4eee372f-ec1e-4b45-bac7-c2fc0f1c9f26 tempest-ProjectReaderTests-330204430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4" returned: 0 in 0.472s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4eee372f-ec1e-4b45-bac7-c2fc0f1c9f26 tempest-ProjectReaderTests-330204430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:09 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4 Sep 25 17:24:09 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:09 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4eee372f-ec1e-4b45-bac7-c2fc0f1c9f26 tempest-ProjectReaderTests-330204430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4" returned: 0 in 0.292s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4eee372f-ec1e-4b45-bac7-c2fc0f1c9f26 tempest-ProjectReaderTests-330204430 None] Lock "cinder-quobyte-d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4" released by "delete_volume" :: held 0.826s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-4eee372f-ec1e-4b45-bac7-c2fc0f1c9f26 tempest-ProjectReaderTests-330204430 None] Created reservations ['e0e076ec-1e03-46f5-9e67-793980d2766f', 'ff46aef4-f51e-43b5-b17e-d141dcf2630e', 'deb37338-698e-49b6-994d-cf95a13ecc48', '7d0607a7-a5df-44f5-868c-b73ff4ca8526'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:09 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e 1073741824" returned: 0 in 0.599s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:09 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-37af17b9-d05b-4be4-a4fd-491af44c427f tempest-VolumeDependencyTests-2109449245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499" returned: 0 in 0.497s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-37af17b9-d05b-4be4-a4fd-491af44c427f tempest-VolumeDependencyTests-2109449245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:09 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499 Sep 25 17:24:09 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:09 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e Sep 25 17:24:09 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4eee372f-ec1e-4b45-bac7-c2fc0f1c9f26 tempest-ProjectReaderTests-330204430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4eee372f-ec1e-4b45-bac7-c2fc0f1c9f26 tempest-ProjectReaderTests-330204430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4eee372f-ec1e-4b45-bac7-c2fc0f1c9f26 tempest-ProjectReaderTests-330204430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4eee372f-ec1e-4b45-bac7-c2fc0f1c9f26 tempest-ProjectReaderTests-330204430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4eee372f-ec1e-4b45-bac7-c2fc0f1c9f26 tempest-ProjectReaderTests-330204430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4eee372f-ec1e-4b45-bac7-c2fc0f1c9f26 tempest-ProjectReaderTests-330204430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:09 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:09 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:09 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-37af17b9-d05b-4be4-a4fd-491af44c427f tempest-VolumeDependencyTests-2109449245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449.1a81452e-5d77-4a8e-9029-8b059b183499" returned: 0 in 0.376s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:09 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e" returned: 0 in 0.353s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:09 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-37af17b9-d05b-4be4-a4fd-491af44c427f tempest-VolumeDependencyTests-2109449245 None] Lock "cinder-quobyte-1a81452e-5d77-4a8e-9029-8b059b183499" released by "_delete_snapshot" :: held 2.492s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd2d4db-d11a-4dd9-805f-3bac8d3b3521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29632c25-89e3-4edd-92fb-e25fde51bb2e', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24349159-346f-4594-aa2a-6a1fe84f0c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-37af17b9-d05b-4be4-a4fd-491af44c427f tempest-VolumeDependencyTests-2109449245 None] Lock "cinder-quobyte-bd66abda-1485-4902-9f60-838b9d783449" released by "delete_snapshot" :: held 2.552s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4eee372f-ec1e-4b45-bac7-c2fc0f1c9f26 tempest-ProjectReaderTests-330204430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.392s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-4eee372f-ec1e-4b45-bac7-c2fc0f1c9f26 tempest-ProjectReaderTests-330204430 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:09 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-4eee372f-ec1e-4b45-bac7-c2fc0f1c9f26 tempest-ProjectReaderTests-330204430 None] Deleted volume successfully. Sep 25 17:24:09 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Volume volume-29632c25-89e3-4edd-92fb-e25fde51bb2e (29632c25-89e3-4edd-92fb-e25fde51bb2e): created successfully Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24349159-346f-4594-aa2a-6a1fe84f0c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Flow 'volume_create_manager' (69024744-069e-4418-9625-e99fa27967d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:09 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-1f6e4c0a-ef82-4b6a-9d4b-4db089c582cf tempest-CreateVolumesFromSnapshotTest-1396798611 None] Created volume successfully. Sep 25 17:24:09 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-4eee372f-ec1e-4b45-bac7-c2fc0f1c9f26 tempest-ProjectReaderTests-330204430 None] Lock "cinder-d78870ea-f3f1-4dc4-ba41-b1b8d3ce76f4-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-37af17b9-d05b-4be4-a4fd-491af44c427f tempest-VolumeDependencyTests-2109449245 None] Created reservations ['57ec5709-92b3-4b5d-95b0-603d65a6b7f9', '91ef77d1-5281-499d-b842-c40ebe9009f2', '1e7aee45-fba0-493a-a300-57bb9be60cc9', '71d19537-d540-458c-b831-3de058d898b0'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:10 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-37af17b9-d05b-4be4-a4fd-491af44c427f tempest-VolumeDependencyTests-2109449245 None] Delete snapshot completed successfully. Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-37af17b9-d05b-4be4-a4fd-491af44c427f tempest-VolumeDependencyTests-2109449245 None] Lock "cinder-1a81452e-5d77-4a8e-9029-8b059b183499-delete_snapshot" released by "delete_snapshot" :: held 2.840s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Flow 'volume_create_manager' (ad69be80-dec1-486b-968b-32adb65dabbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc3fbb5-ef7e-47b0-a628-65787bb8635d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc3fbb5-ef7e-47b0-a628-65787bb8635d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39327452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc8b986-e4c4-4a43-98cd-c33234c31d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a9728775254468a03d6b90bc00069d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:10Z,use_quota=True,user_id='19c5d266957c4aa994c1c274ce094045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413a35a4-531b-44fd-a151-1afdb1a5b7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413a35a4-531b-44fd-a151-1afdb1a5b7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f69ee56-2f63-4126-94e0-b7bf02270b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f69ee56-2f63-4126-94e0-b7bf02270b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbc8b986-e4c4-4a43-98cd-c33234c31d0b', 'volume_name': 'volume-cbc8b986-e4c4-4a43-98cd-c33234c31d0b', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0669624a-40c8-4149-9f54-3d7b8aa8bf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0669624a-40c8-4149-9f54-3d7b8aa8bf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (758a0b0f-bf71-41f2-836d-889e25cb7a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:10 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Volume cbc8b986-e4c4-4a43-98cd-c33234c31d0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbc8b986-e4c4-4a43-98cd-c33234c31d0b', 'volume_size': 1} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39327452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc8b986-e4c4-4a43-98cd-c33234c31d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a9728775254468a03d6b90bc00069d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:10Z,use_quota=True,user_id='19c5d266957c4aa994c1c274ce094045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Creating volume cbc8b986-e4c4-4a43-98cd-c33234c31d0b {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:10 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cbc8b986-e4c4-4a43-98cd-c33234c31d0b 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:10 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cbc8b986-e4c4-4a43-98cd-c33234c31d0b 1073741824 Sep 25 17:24:10 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7ee91a73-00d8-49d5-aa32-29b3545da008 tempest-VolumeDependencyTests-2109449245 None] Acquiring lock "cinder-bd66abda-1485-4902-9f60-838b9d783449-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7ee91a73-00d8-49d5-aa32-29b3545da008 tempest-VolumeDependencyTests-2109449245 None] Lock "cinder-bd66abda-1485-4902-9f60-838b9d783449-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7ee91a73-00d8-49d5-aa32-29b3545da008 tempest-VolumeDependencyTests-2109449245 None] Acquiring lock "cinder-quobyte-bd66abda-1485-4902-9f60-838b9d783449" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7ee91a73-00d8-49d5-aa32-29b3545da008 tempest-VolumeDependencyTests-2109449245 None] Lock "cinder-quobyte-bd66abda-1485-4902-9f60-838b9d783449" acquired by "delete_volume" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c131b98-9956-4801-86d4-8b402c945d91]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7ee91a73-00d8-49d5-aa32-29b3545da008 tempest-VolumeDependencyTests-2109449245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:10 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449 Sep 25 17:24:10 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:10 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cbc8b986-e4c4-4a43-98cd-c33234c31d0b 1073741824" returned: 0 in 0.593s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cbc8b986-e4c4-4a43-98cd-c33234c31d0b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:11 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cbc8b986-e4c4-4a43-98cd-c33234c31d0b Sep 25 17:24:11 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7743d6e4-f112-40fb-969b-5d61395ad784 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:11 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7ee91a73-00d8-49d5-aa32-29b3545da008 tempest-VolumeDependencyTests-2109449245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449" returned: 0 in 0.471s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7ee91a73-00d8-49d5-aa32-29b3545da008 tempest-VolumeDependencyTests-2109449245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:11 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449 Sep 25 17:24:11 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:11 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cbc8b986-e4c4-4a43-98cd-c33234c31d0b" returned: 0 in 0.322s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7743d6e4-f112-40fb-969b-5d61395ad784 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.229s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (758a0b0f-bf71-41f2-836d-889e25cb7a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbc8b986-e4c4-4a43-98cd-c33234c31d0b', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b21f12-f7b0-4af4-8fb8-6c36cdd2eeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-7743d6e4-f112-40fb-969b-5d61395ad784 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Creating offline snapshot b3862d83-cb05-4043-964e-806034aa5cc8 of volume 29632c25-89e3-4edd-92fb-e25fde51bb2e {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:24:11 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Volume volume-cbc8b986-e4c4-4a43-98cd-c33234c31d0b (cbc8b986-e4c4-4a43-98cd-c33234c31d0b): created successfully Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b21f12-f7b0-4af4-8fb8-6c36cdd2eeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Flow 'volume_create_manager' (ad69be80-dec1-486b-968b-32adb65dabbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba3cb5c-32d7-484e-ba6e-e1e8b287776b]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7743d6e4-f112-40fb-969b-5d61395ad784 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:11 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b226c01c-7c07-40a7-bc96-a3c7b44431eb tempest-ProjectReaderTests-330204430 None] Created volume successfully. Sep 25 17:24:11 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7ee91a73-00d8-49d5-aa32-29b3545da008 tempest-VolumeDependencyTests-2109449245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-bd66abda-1485-4902-9f60-838b9d783449" returned: 0 in 0.339s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7ee91a73-00d8-49d5-aa32-29b3545da008 tempest-VolumeDependencyTests-2109449245 None] Lock "cinder-quobyte-bd66abda-1485-4902-9f60-838b9d783449" released by "delete_volume" :: held 0.883s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-7ee91a73-00d8-49d5-aa32-29b3545da008 tempest-VolumeDependencyTests-2109449245 None] Created reservations ['885bf88d-16ba-4ddd-99ab-741e7b1ce913', 'd58fdc15-567d-475e-9aba-b21f2d451138', '2b804c06-13f4-4411-9a14-5fcb2e7d2a2a', '39b55ea0-120d-43ee-91b5-0fbb527935f1'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:11 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e Sep 25 17:24:11 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7ee91a73-00d8-49d5-aa32-29b3545da008 tempest-VolumeDependencyTests-2109449245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7ee91a73-00d8-49d5-aa32-29b3545da008 tempest-VolumeDependencyTests-2109449245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7ee91a73-00d8-49d5-aa32-29b3545da008 tempest-VolumeDependencyTests-2109449245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-7ee91a73-00d8-49d5-aa32-29b3545da008 tempest-VolumeDependencyTests-2109449245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7ee91a73-00d8-49d5-aa32-29b3545da008 tempest-VolumeDependencyTests-2109449245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7ee91a73-00d8-49d5-aa32-29b3545da008 tempest-VolumeDependencyTests-2109449245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:11 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:11 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a3d30128-d201-46ac-967a-59c1e484403a tempest-VolumeDependencyTests-2109449245 None] Acquiring lock "cinder-97ba081b-4f92-4057-9c3e-645a988fa178-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a3d30128-d201-46ac-967a-59c1e484403a tempest-VolumeDependencyTests-2109449245 None] Lock "cinder-97ba081b-4f92-4057-9c3e-645a988fa178-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a3d30128-d201-46ac-967a-59c1e484403a tempest-VolumeDependencyTests-2109449245 None] Acquiring lock "cinder-quobyte-97ba081b-4f92-4057-9c3e-645a988fa178" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a3d30128-d201-46ac-967a-59c1e484403a tempest-VolumeDependencyTests-2109449245 None] Lock "cinder-quobyte-97ba081b-4f92-4057-9c3e-645a988fa178" acquired by "delete_volume" :: waited 0.034s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efdd9f0-f0e7-4081-a393-2f313d50e74e]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a3d30128-d201-46ac-967a-59c1e484403a tempest-VolumeDependencyTests-2109449245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97ba081b-4f92-4057-9c3e-645a988fa178 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:11 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7743d6e4-f112-40fb-969b-5d61395ad784 tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e" returned: 0 in 0.590s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7743d6e4-f112-40fb-969b-5d61395ad784 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.b3862d83-cb05-4043-964e-806034aa5cc8 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:12 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:12 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.b3862d83-cb05-4043-964e-806034aa5cc8 1G Sep 25 17:24:12 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7ee91a73-00d8-49d5-aa32-29b3545da008 tempest-VolumeDependencyTests-2109449245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.389s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-7ee91a73-00d8-49d5-aa32-29b3545da008 tempest-VolumeDependencyTests-2109449245 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:12 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97ba081b-4f92-4057-9c3e-645a988fa178 Sep 25 17:24:12 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:12 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-7ee91a73-00d8-49d5-aa32-29b3545da008 tempest-VolumeDependencyTests-2109449245 None] Deleted volume successfully. Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Flow 'volume_create_manager' (9ad5729b-a518-4e9e-b88e-c5664636dc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef44c5c2-b683-4089-8d4b-fba61dd22e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef44c5c2-b683-4089-8d4b-fba61dd22e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1299136142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=217f0e60-47a0-46d7-b55c-654bd199fdfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31fdfb42d1d48219cd53e16d4a0131f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:12Z,use_quota=True,user_id='645f5007ad61465e9de1ac84410dacf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510fc5fe-8cf5-4e65-a897-847d8f1c3133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510fc5fe-8cf5-4e65-a897-847d8f1c3133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4353d53e-1dee-4f91-bb4c-6599f290d1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4353d53e-1dee-4f91-bb4c-6599f290d1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '217f0e60-47a0-46d7-b55c-654bd199fdfd', 'volume_name': 'volume-217f0e60-47a0-46d7-b55c-654bd199fdfd', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5da1d3-57b8-41e1-b176-c47e6f8a8553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5da1d3-57b8-41e1-b176-c47e6f8a8553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34904deb-3553-4f05-882f-16ccf7b98f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:12 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Volume 217f0e60-47a0-46d7-b55c-654bd199fdfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-217f0e60-47a0-46d7-b55c-654bd199fdfd', 'volume_size': 1} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7ee91a73-00d8-49d5-aa32-29b3545da008 tempest-VolumeDependencyTests-2109449245 None] Lock "cinder-bd66abda-1485-4902-9f60-838b9d783449-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:12 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a3d30128-d201-46ac-967a-59c1e484403a tempest-VolumeDependencyTests-2109449245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97ba081b-4f92-4057-9c3e-645a988fa178" returned: 0 in 0.444s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a3d30128-d201-46ac-967a-59c1e484403a tempest-VolumeDependencyTests-2109449245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97ba081b-4f92-4057-9c3e-645a988fa178 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:12 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97ba081b-4f92-4057-9c3e-645a988fa178 Sep 25 17:24:12 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b148f124-17c4-4a1d-a821-69f0abf246ea tempest-ProjectReaderTests-330204430 None] Acquiring lock "cinder-cbc8b986-e4c4-4a43-98cd-c33234c31d0b-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b148f124-17c4-4a1d-a821-69f0abf246ea tempest-ProjectReaderTests-330204430 None] Lock "cinder-cbc8b986-e4c4-4a43-98cd-c33234c31d0b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b148f124-17c4-4a1d-a821-69f0abf246ea tempest-ProjectReaderTests-330204430 None] Acquiring lock "cinder-quobyte-cbc8b986-e4c4-4a43-98cd-c33234c31d0b" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:12 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7743d6e4-f112-40fb-969b-5d61395ad784 tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.b3862d83-cb05-4043-964e-806034aa5cc8 1G" returned: 0 in 0.553s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7743d6e4-f112-40fb-969b-5d61395ad784 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29632c25-89e3-4edd-92fb-e25fde51bb2e -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.b3862d83-cb05-4043-964e-806034aa5cc8 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b148f124-17c4-4a1d-a821-69f0abf246ea tempest-ProjectReaderTests-330204430 None] Lock "cinder-quobyte-cbc8b986-e4c4-4a43-98cd-c33234c31d0b" acquired by "delete_volume" :: waited 0.025s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:12 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29632c25-89e3-4edd-92fb-e25fde51bb2e -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.b3862d83-cb05-4043-964e-806034aa5cc8 Sep 25 17:24:12 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a799c8-dcd0-485c-b9cd-b77b81bad591]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b148f124-17c4-4a1d-a821-69f0abf246ea tempest-ProjectReaderTests-330204430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cbc8b986-e4c4-4a43-98cd-c33234c31d0b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:12 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a3d30128-d201-46ac-967a-59c1e484403a tempest-VolumeDependencyTests-2109449245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-97ba081b-4f92-4057-9c3e-645a988fa178" returned: 0 in 0.306s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a3d30128-d201-46ac-967a-59c1e484403a tempest-VolumeDependencyTests-2109449245 None] Lock "cinder-quobyte-97ba081b-4f92-4057-9c3e-645a988fa178" released by "delete_volume" :: held 0.808s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-a3d30128-d201-46ac-967a-59c1e484403a tempest-VolumeDependencyTests-2109449245 None] Created reservations ['56cadff0-bf58-4125-8428-2a199ce6c412', '2c28c40c-6dd8-439c-b03c-7c500dd28944', '6d9e0bee-8d89-43b7-9ba9-5cd4844235de', '4dff47f4-0692-4d52-b359-a9b7babb6669'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:12 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cbc8b986-e4c4-4a43-98cd-c33234c31d0b Sep 25 17:24:12 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a3d30128-d201-46ac-967a-59c1e484403a tempest-VolumeDependencyTests-2109449245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a3d30128-d201-46ac-967a-59c1e484403a tempest-VolumeDependencyTests-2109449245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a3d30128-d201-46ac-967a-59c1e484403a tempest-VolumeDependencyTests-2109449245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a3d30128-d201-46ac-967a-59c1e484403a tempest-VolumeDependencyTests-2109449245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a3d30128-d201-46ac-967a-59c1e484403a tempest-VolumeDependencyTests-2109449245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a3d30128-d201-46ac-967a-59c1e484403a tempest-VolumeDependencyTests-2109449245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:12 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:12 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:12 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7743d6e4-f112-40fb-969b-5d61395ad784 tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29632c25-89e3-4edd-92fb-e25fde51bb2e -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.b3862d83-cb05-4043-964e-806034aa5cc8" returned: 0 in 0.374s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:12 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-7743d6e4-f112-40fb-969b-5d61395ad784 tempest-CreateVolumesFromSnapshotTest-1396798611 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.b3862d83-cb05-4043-964e-806034aa5cc8 is being set with open permissions: ugo+rw Sep 25 17:24:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7743d6e4-f112-40fb-969b-5d61395ad784 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.b3862d83-cb05-4043-964e-806034aa5cc8 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:12 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.b3862d83-cb05-4043-964e-806034aa5cc8 Sep 25 17:24:12 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:13 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a3d30128-d201-46ac-967a-59c1e484403a tempest-VolumeDependencyTests-2109449245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.337s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-a3d30128-d201-46ac-967a-59c1e484403a tempest-VolumeDependencyTests-2109449245 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:13 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b148f124-17c4-4a1d-a821-69f0abf246ea tempest-ProjectReaderTests-330204430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cbc8b986-e4c4-4a43-98cd-c33234c31d0b" returned: 0 in 0.555s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b148f124-17c4-4a1d-a821-69f0abf246ea tempest-ProjectReaderTests-330204430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cbc8b986-e4c4-4a43-98cd-c33234c31d0b {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:13 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-a3d30128-d201-46ac-967a-59c1e484403a tempest-VolumeDependencyTests-2109449245 None] Deleted volume successfully. Sep 25 17:24:13 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cbc8b986-e4c4-4a43-98cd-c33234c31d0b Sep 25 17:24:13 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a3d30128-d201-46ac-967a-59c1e484403a tempest-VolumeDependencyTests-2109449245 None] Lock "cinder-97ba081b-4f92-4057-9c3e-645a988fa178-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:13 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7743d6e4-f112-40fb-969b-5d61395ad784 tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.b3862d83-cb05-4043-964e-806034aa5cc8" returned: 0 in 0.372s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7743d6e4-f112-40fb-969b-5d61395ad784 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:13 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.info Sep 25 17:24:13 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:13 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b148f124-17c4-4a1d-a821-69f0abf246ea tempest-ProjectReaderTests-330204430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cbc8b986-e4c4-4a43-98cd-c33234c31d0b" returned: 0 in 0.317s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b148f124-17c4-4a1d-a821-69f0abf246ea tempest-ProjectReaderTests-330204430 None] Lock "cinder-quobyte-cbc8b986-e4c4-4a43-98cd-c33234c31d0b" released by "delete_volume" :: held 0.934s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-b148f124-17c4-4a1d-a821-69f0abf246ea tempest-ProjectReaderTests-330204430 None] Created reservations ['b3806c1f-c847-4acb-9b7c-9c231200facc', '382e7d1c-2dfa-42df-8fdb-7986ccb96fac', '0155b355-f743-41d0-beac-ccdff3238385', '33c7e3fb-2fde-4d0f-9285-eb89ac3d1aec'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:13 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7743d6e4-f112-40fb-969b-5d61395ad784 tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.info" returned: 0 in 0.296s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:13 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-7743d6e4-f112-40fb-969b-5d61395ad784 tempest-CreateVolumesFromSnapshotTest-1396798611 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.info is being set with open permissions: ugo+rw Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7743d6e4-f112-40fb-969b-5d61395ad784 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:13 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.info Sep 25 17:24:13 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b148f124-17c4-4a1d-a821-69f0abf246ea tempest-ProjectReaderTests-330204430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b148f124-17c4-4a1d-a821-69f0abf246ea tempest-ProjectReaderTests-330204430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b148f124-17c4-4a1d-a821-69f0abf246ea tempest-ProjectReaderTests-330204430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b148f124-17c4-4a1d-a821-69f0abf246ea tempest-ProjectReaderTests-330204430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b148f124-17c4-4a1d-a821-69f0abf246ea tempest-ProjectReaderTests-330204430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b148f124-17c4-4a1d-a821-69f0abf246ea tempest-ProjectReaderTests-330204430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:13 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:13 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:13 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7743d6e4-f112-40fb-969b-5d61395ad784 tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.info" returned: 0 in 0.291s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7743d6e4-f112-40fb-969b-5d61395ad784 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.630s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.784s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1299136142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=217f0e60-47a0-46d7-b55c-654bd199fdfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31fdfb42d1d48219cd53e16d4a0131f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:12Z,use_quota=True,user_id='645f5007ad61465e9de1ac84410dacf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Creating volume 217f0e60-47a0-46d7-b55c-654bd199fdfd {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:13 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:14 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd 1073741824 Sep 25 17:24:14 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:14 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-7743d6e4-f112-40fb-969b-5d61395ad784 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Create snapshot completed successfully Sep 25 17:24:14 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b148f124-17c4-4a1d-a821-69f0abf246ea tempest-ProjectReaderTests-330204430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.363s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:14 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-b148f124-17c4-4a1d-a821-69f0abf246ea tempest-ProjectReaderTests-330204430 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:14 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b148f124-17c4-4a1d-a821-69f0abf246ea tempest-ProjectReaderTests-330204430 None] Deleted volume successfully. Sep 25 17:24:14 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b148f124-17c4-4a1d-a821-69f0abf246ea tempest-ProjectReaderTests-330204430 None] Lock "cinder-cbc8b986-e4c4-4a43-98cd-c33234c31d0b-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:14 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd 1073741824" returned: 0 in 0.654s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:14 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd Sep 25 17:24:14 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:14 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Flow 'volume_create_manager' (0b9e391f-1a3f-43f8-aa04-2f66dfedd6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e521032d-7985-44e4-b2e2-5cd8ae98436a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e521032d-7985-44e4-b2e2-5cd8ae98436a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-543867640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40348ca9-b1da-4903-be52-150fb6174559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b8a542aaf842a6bb50594d57f8fd78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:15Z,use_quota=True,user_id='b740ac554694435ebc3baf8b86d0f6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d17f63-0c6e-45e9-8c3e-73f6e25a95c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d17f63-0c6e-45e9-8c3e-73f6e25a95c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfac3037-2026-46cd-b026-6533ab33f7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfac3037-2026-46cd-b026-6533ab33f7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40348ca9-b1da-4903-be52-150fb6174559', 'volume_name': 'volume-40348ca9-b1da-4903-be52-150fb6174559', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7adf484-3670-4f49-b2be-dfcdc28dec2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7adf484-3670-4f49-b2be-dfcdc28dec2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:14 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e229928-387c-4140-8c7a-cd511c892405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:14 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Volume 40348ca9-b1da-4903-be52-150fb6174559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40348ca9-b1da-4903-be52-150fb6174559', 'volume_size': 1} Sep 25 17:24:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:15 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd" returned: 0 in 0.474s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.243s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-543867640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40348ca9-b1da-4903-be52-150fb6174559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b8a542aaf842a6bb50594d57f8fd78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:15Z,use_quota=True,user_id='b740ac554694435ebc3baf8b86d0f6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Creating volume 40348ca9-b1da-4903-be52-150fb6174559 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:15 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-40348ca9-b1da-4903-be52-150fb6174559 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34904deb-3553-4f05-882f-16ccf7b98f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-217f0e60-47a0-46d7-b55c-654bd199fdfd', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:15 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-40348ca9-b1da-4903-be52-150fb6174559 1073741824 Sep 25 17:24:15 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a273d6c-8b0d-44f9-8db1-a32c935218ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:15 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Volume volume-217f0e60-47a0-46d7-b55c-654bd199fdfd (217f0e60-47a0-46d7-b55c-654bd199fdfd): created successfully Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a273d6c-8b0d-44f9-8db1-a32c935218ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Flow 'volume_create_manager' (9ad5729b-a518-4e9e-b88e-c5664636dc7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:15 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b3c2d588-b758-41f4-8394-4643d629c8a9 tempest-ProjectMemberTests-1497756053 None] Created volume successfully. Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Flow 'volume_create_manager' (cc7209b4-10c6-4053-b06f-37fba9635a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d72be6-504f-49a6-8342-e25e3f4bb79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d72be6-504f-49a6-8342-e25e3f4bb79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2040081894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa88f85-b65d-4f2d-b905-21d8aab75411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b8a542aaf842a6bb50594d57f8fd78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:15Z,use_quota=True,user_id='b740ac554694435ebc3baf8b86d0f6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1300d4ca-caf2-4dbc-aeac-e510a3d14840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1300d4ca-caf2-4dbc-aeac-e510a3d14840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58b02dca-0277-4a5e-b79c-3004d4f5d8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58b02dca-0277-4a5e-b79c-3004d4f5d8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfa88f85-b65d-4f2d-b905-21d8aab75411', 'volume_name': 'volume-cfa88f85-b65d-4f2d-b905-21d8aab75411', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4368c00a-51da-4905-8d84-f5e9566cd336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4368c00a-51da-4905-8d84-f5e9566cd336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ac1f89-724b-45fa-b91f-8c2da56f1389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:15 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Volume cfa88f85-b65d-4f2d-b905-21d8aab75411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfa88f85-b65d-4f2d-b905-21d8aab75411', 'volume_size': 1} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Flow 'volume_create_manager' (1ec0fb52-2c89-4b0a-a6d6-fd4f5ca3900e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f3563cd-994d-4444-9df1-6d447fbcb351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f3563cd-994d-4444-9df1-6d447fbcb351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2123098882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff52aca-cc3f-4043-86c9-06d6328f9796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a9728775254468a03d6b90bc00069d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:16Z,use_quota=True,user_id='19c5d266957c4aa994c1c274ce094045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16667a50-98fa-4e73-9b22-77ca8defee6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16667a50-98fa-4e73-9b22-77ca8defee6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:15 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35e04be8-d561-47ab-a8b1-cda458253660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35e04be8-d561-47ab-a8b1-cda458253660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ff52aca-cc3f-4043-86c9-06d6328f9796', 'volume_name': 'volume-6ff52aca-cc3f-4043-86c9-06d6328f9796', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d919209-a590-4a2e-9540-037b1df06ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d919209-a590-4a2e-9540-037b1df06ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5213b852-7687-476b-b629-c149f5f09157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:16 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Volume 6ff52aca-cc3f-4043-86c9-06d6328f9796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ff52aca-cc3f-4043-86c9-06d6328f9796', 'volume_size': 1} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:16 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-40348ca9-b1da-4903-be52-150fb6174559 1073741824" returned: 0 in 0.830s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-40348ca9-b1da-4903-be52-150fb6174559 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:16 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-40348ca9-b1da-4903-be52-150fb6174559 Sep 25 17:24:16 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Flow 'volume_create_manager' (3627c3ca-f20c-4991-b5f0-dd4d8376381e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef9475ca-6cba-4802-ab70-c183ebb78836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef9475ca-6cba-4802-ab70-c183ebb78836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1482448919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b8a542aaf842a6bb50594d57f8fd78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:16Z,use_quota=True,user_id='b740ac554694435ebc3baf8b86d0f6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6827d64e-cc1e-4575-abd1-8abdf7ebe0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6827d64e-cc1e-4575-abd1-8abdf7ebe0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bcf72b5-76b9-4064-97c8-6692c5556094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bcf72b5-76b9-4064-97c8-6692c5556094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc', 'volume_name': 'volume-7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (809be1c4-e345-44ec-af6f-260083c96940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (809be1c4-e345-44ec-af6f-260083c96940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb24ba1b-1434-43f2-aa3d-9dbe75731aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:16 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Volume 7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc', 'volume_size': 1} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:16 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-40348ca9-b1da-4903-be52-150fb6174559" returned: 0 in 0.410s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.992s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2040081894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa88f85-b65d-4f2d-b905-21d8aab75411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b8a542aaf842a6bb50594d57f8fd78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:15Z,use_quota=True,user_id='b740ac554694435ebc3baf8b86d0f6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Creating volume cfa88f85-b65d-4f2d-b905-21d8aab75411 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:16 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cfa88f85-b65d-4f2d-b905-21d8aab75411 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e229928-387c-4140-8c7a-cd511c892405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40348ca9-b1da-4903-be52-150fb6174559', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf424979-5687-475e-8b7c-8d7c7995c14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:16 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cfa88f85-b65d-4f2d-b905-21d8aab75411 1073741824 Sep 25 17:24:16 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:16 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Volume volume-40348ca9-b1da-4903-be52-150fb6174559 (40348ca9-b1da-4903-be52-150fb6174559): created successfully Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf424979-5687-475e-8b7c-8d7c7995c14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Flow 'volume_create_manager' (0b9e391f-1a3f-43f8-aa04-2f66dfedd6ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Flow 'volume_create_manager' (9c93529d-f4f0-446e-9549-395ddc2c0d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324ff0b4-f3ac-45ad-9f66-a536d35521e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:16 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-0767588b-e9df-4304-80d1-e3b92b5e4c0f tempest-CreateVolumesFromSnapshotTest-1396798611 None] Created volume successfully. Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324ff0b4-f3ac-45ad-9f66-a536d35521e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-923319565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f66ac5-cedd-4bc7-8204-328470519de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b8a542aaf842a6bb50594d57f8fd78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:17Z,use_quota=True,user_id='b740ac554694435ebc3baf8b86d0f6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65813555-b817-4d7c-8024-78c02bb4bc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65813555-b817-4d7c-8024-78c02bb4bc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c94721ff-544d-43f7-b0e3-7775fb627f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c94721ff-544d-43f7-b0e3-7775fb627f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46f66ac5-cedd-4bc7-8204-328470519de4', 'volume_name': 'volume-46f66ac5-cedd-4bc7-8204-328470519de4', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7813abde-f7d4-45ad-ab2c-d6a1d2e51b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7813abde-f7d4-45ad-ab2c-d6a1d2e51b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bee3c1b-9719-4536-99d1-de1fc071eb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:16 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Volume 46f66ac5-cedd-4bc7-8204-328470519de4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46f66ac5-cedd-4bc7-8204-328470519de4', 'volume_size': 1} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-790849e7-3307-42e7-a7f4-c38ca3c11bc6 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Flow 'volume_create_manager' (db235d65-0802-4af9-b496-edaf994e4eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad377081-c8bf-41b2-85a7-a0bd1c19c90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad377081-c8bf-41b2-85a7-a0bd1c19c90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-636312627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138dc40c-f098-4ae2-b589-9e5482c863a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b8a542aaf842a6bb50594d57f8fd78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:17Z,use_quota=True,user_id='b740ac554694435ebc3baf8b86d0f6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e80f390-f34e-45c1-9630-e69dc3452b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e80f390-f34e-45c1-9630-e69dc3452b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b806f2e9-51fa-461c-af75-8057d3056f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b806f2e9-51fa-461c-af75-8057d3056f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '138dc40c-f098-4ae2-b589-9e5482c863a3', 'volume_name': 'volume-138dc40c-f098-4ae2-b589-9e5482c863a3', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c03215-5f99-401a-849f-0d906d51f08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:17 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c03215-5f99-401a-849f-0d906d51f08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0273f78-850e-4b7b-8918-9a6bb954fa09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:17 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Volume 138dc40c-f098-4ae2-b589-9e5482c863a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-138dc40c-f098-4ae2-b589-9e5482c863a3', 'volume_size': 1} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cfa88f85-b65d-4f2d-b905-21d8aab75411 1073741824" returned: 0 in 0.664s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cfa88f85-b65d-4f2d-b905-21d8aab75411 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:17 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cfa88f85-b65d-4f2d-b905-21d8aab75411 Sep 25 17:24:17 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:17 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cfa88f85-b65d-4f2d-b905-21d8aab75411" returned: 0 in 0.282s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.460s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2123098882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff52aca-cc3f-4043-86c9-06d6328f9796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a9728775254468a03d6b90bc00069d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:16Z,use_quota=True,user_id='19c5d266957c4aa994c1c274ce094045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Creating volume 6ff52aca-cc3f-4043-86c9-06d6328f9796 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:17 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6ff52aca-cc3f-4043-86c9-06d6328f9796 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:17 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6ff52aca-cc3f-4043-86c9-06d6328f9796 1073741824 Sep 25 17:24:17 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Flow 'volume_create_manager' (fe6ecb46-1222-4c3a-b653-d93bef46ce1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b5cc14-d4b5-4825-96b2-04447395c720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ac1f89-724b-45fa-b91f-8c2da56f1389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfa88f85-b65d-4f2d-b905-21d8aab75411', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ca316f-1285-45a7-87f7-76cbf2b7074c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b5cc14-d4b5-4825-96b2-04447395c720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03423c4e-5777-4d69-a1d7-bbc9fa1929f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aedf0c5fa36144ea875e1f673b74ff79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:17Z,use_quota=True,user_id='36061ac304a047c7b966a318f3db1746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94cd2d8-fb75-44eb-b8d9-cc52fe636191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94cd2d8-fb75-44eb-b8d9-cc52fe636191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (985d0663-0bef-4462-bb52-3014ce7dfd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (985d0663-0bef-4462-bb52-3014ce7dfd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03423c4e-5777-4d69-a1d7-bbc9fa1929f5', 'volume_name': 'volume-03423c4e-5777-4d69-a1d7-bbc9fa1929f5', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37a0d1bc-6dff-46bc-9a78-b36071e24614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37a0d1bc-6dff-46bc-9a78-b36071e24614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e336d57-b0b7-40bb-85a3-cec18988fa13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:17 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Volume 03423c4e-5777-4d69-a1d7-bbc9fa1929f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03423c4e-5777-4d69-a1d7-bbc9fa1929f5', 'volume_size': 1} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:17 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Volume volume-cfa88f85-b65d-4f2d-b905-21d8aab75411 (cfa88f85-b65d-4f2d-b905-21d8aab75411): created successfully Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ca316f-1285-45a7-87f7-76cbf2b7074c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Flow 'volume_create_manager' (cc7209b4-10c6-4053-b06f-37fba9635a0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:17 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-4ee197c2-013f-4d16-b441-76f8bf61f35c tempest-CreateVolumesFromSnapshotTest-1396798611 None] Created volume successfully. Sep 25 17:24:18 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6ff52aca-cc3f-4043-86c9-06d6328f9796 1073741824" returned: 0 in 0.512s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6ff52aca-cc3f-4043-86c9-06d6328f9796 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:18 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6ff52aca-cc3f-4043-86c9-06d6328f9796 Sep 25 17:24:18 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:18 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6ff52aca-cc3f-4043-86c9-06d6328f9796" returned: 0 in 0.303s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:18 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:18 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1482448919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b8a542aaf842a6bb50594d57f8fd78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:16Z,use_quota=True,user_id='b740ac554694435ebc3baf8b86d0f6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:18 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Creating volume 7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:18 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:18 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:18 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:18 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:18 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5213b852-7687-476b-b629-c149f5f09157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ff52aca-cc3f-4043-86c9-06d6328f9796', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:18 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2e6f3d-b1cd-4d46-aa87-a2dd045dc2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:18 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc 1073741824 Sep 25 17:24:18 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:18 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Volume volume-6ff52aca-cc3f-4043-86c9-06d6328f9796 (6ff52aca-cc3f-4043-86c9-06d6328f9796): created successfully Sep 25 17:24:18 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2e6f3d-b1cd-4d46-aa87-a2dd045dc2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:18 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Flow 'volume_create_manager' (1ec0fb52-2c89-4b0a-a6d6-fd4f5ca3900e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:18 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-8a93b1dd-93f2-4949-98b1-82d0b0045fa1 tempest-ProjectReaderTests-330204430 None] Created volume successfully. Sep 25 17:24:18 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc 1073741824" returned: 0 in 0.415s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:18 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc Sep 25 17:24:18 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:19 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc" returned: 0 in 0.264s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.370s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-923319565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f66ac5-cedd-4bc7-8204-328470519de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b8a542aaf842a6bb50594d57f8fd78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:17Z,use_quota=True,user_id='b740ac554694435ebc3baf8b86d0f6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Creating volume 46f66ac5-cedd-4bc7-8204-328470519de4 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:19 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46f66ac5-cedd-4bc7-8204-328470519de4 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-65f3ffed-49b2-44b9-b6a7-6d9aab368edf tempest-ProjectReaderTests-330204430 None] Acquiring lock "cinder-6ff52aca-cc3f-4043-86c9-06d6328f9796-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:19 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46f66ac5-cedd-4bc7-8204-328470519de4 1073741824 Sep 25 17:24:19 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb24ba1b-1434-43f2-aa3d-9dbe75731aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e426aff-10f7-4172-8a75-c8acbe6cb93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-65f3ffed-49b2-44b9-b6a7-6d9aab368edf tempest-ProjectReaderTests-330204430 None] Lock "cinder-6ff52aca-cc3f-4043-86c9-06d6328f9796-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:19 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Volume volume-7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc (7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc): created successfully Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e426aff-10f7-4172-8a75-c8acbe6cb93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Flow 'volume_create_manager' (3627c3ca-f20c-4991-b5f0-dd4d8376381e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:19 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-fb9a1235-b899-467e-8259-e38d06643d5e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Created volume successfully. Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-65f3ffed-49b2-44b9-b6a7-6d9aab368edf tempest-ProjectReaderTests-330204430 None] Acquiring lock "cinder-quobyte-6ff52aca-cc3f-4043-86c9-06d6328f9796" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-65f3ffed-49b2-44b9-b6a7-6d9aab368edf tempest-ProjectReaderTests-330204430 None] Lock "cinder-quobyte-6ff52aca-cc3f-4043-86c9-06d6328f9796" acquired by "delete_volume" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[186a9a89-5206-4dac-b89e-ec136891e83a]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-65f3ffed-49b2-44b9-b6a7-6d9aab368edf tempest-ProjectReaderTests-330204430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6ff52aca-cc3f-4043-86c9-06d6328f9796 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:19 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6ff52aca-cc3f-4043-86c9-06d6328f9796 Sep 25 17:24:19 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:19 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46f66ac5-cedd-4bc7-8204-328470519de4 1073741824" returned: 0 in 0.534s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:19 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46f66ac5-cedd-4bc7-8204-328470519de4 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-65f3ffed-49b2-44b9-b6a7-6d9aab368edf tempest-ProjectReaderTests-330204430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6ff52aca-cc3f-4043-86c9-06d6328f9796" returned: 0 in 0.399s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-65f3ffed-49b2-44b9-b6a7-6d9aab368edf tempest-ProjectReaderTests-330204430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6ff52aca-cc3f-4043-86c9-06d6328f9796 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:19 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46f66ac5-cedd-4bc7-8204-328470519de4 Sep 25 17:24:19 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:19 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6ff52aca-cc3f-4043-86c9-06d6328f9796 Sep 25 17:24:19 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:19 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46f66ac5-cedd-4bc7-8204-328470519de4" returned: 0 in 0.251s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:19 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-790849e7-3307-42e7-a7f4-c38ca3c11bc6 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.191s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-65f3ffed-49b2-44b9-b6a7-6d9aab368edf tempest-ProjectReaderTests-330204430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6ff52aca-cc3f-4043-86c9-06d6328f9796" returned: 0 in 0.251s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bee3c1b-9719-4536-99d1-de1fc071eb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46f66ac5-cedd-4bc7-8204-328470519de4', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ebb7ed-95f9-42c4-afca-d3547cf927f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-790849e7-3307-42e7-a7f4-c38ca3c11bc6 tempest-ProjectMemberTests-1497756053 None] Creating offline snapshot a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e of volume 217f0e60-47a0-46d7-b55c-654bd199fdfd {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-65f3ffed-49b2-44b9-b6a7-6d9aab368edf tempest-ProjectReaderTests-330204430 None] Lock "cinder-quobyte-6ff52aca-cc3f-4043-86c9-06d6328f9796" released by "delete_volume" :: held 0.727s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:20 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Volume volume-46f66ac5-cedd-4bc7-8204-328470519de4 (46f66ac5-cedd-4bc7-8204-328470519de4): created successfully Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ebb7ed-95f9-42c4-afca-d3547cf927f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Flow 'volume_create_manager' (9c93529d-f4f0-446e-9549-395ddc2c0d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f1e911-71d8-4a6c-8be0-5c0188a0ede2]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-790849e7-3307-42e7-a7f4-c38ca3c11bc6 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:20 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-2fc1c450-4bf9-458c-8d23-2293755edc6b tempest-CreateVolumesFromSnapshotTest-1396798611 None] Created volume successfully. Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-65f3ffed-49b2-44b9-b6a7-6d9aab368edf tempest-ProjectReaderTests-330204430 None] Created reservations ['a602b027-2d4f-421d-a604-92e009473bac', '1713b124-20cf-4d2c-8081-c2a2cc399b75', '848dbcb5-dc87-4324-b9b3-80c589908488', '236734e1-2fdf-4d14-bd35-25a364c974a7'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:20 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd Sep 25 17:24:20 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-65f3ffed-49b2-44b9-b6a7-6d9aab368edf tempest-ProjectReaderTests-330204430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-65f3ffed-49b2-44b9-b6a7-6d9aab368edf tempest-ProjectReaderTests-330204430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-65f3ffed-49b2-44b9-b6a7-6d9aab368edf tempest-ProjectReaderTests-330204430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-65f3ffed-49b2-44b9-b6a7-6d9aab368edf tempest-ProjectReaderTests-330204430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-65f3ffed-49b2-44b9-b6a7-6d9aab368edf tempest-ProjectReaderTests-330204430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-65f3ffed-49b2-44b9-b6a7-6d9aab368edf tempest-ProjectReaderTests-330204430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:20 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:20 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:20 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-65f3ffed-49b2-44b9-b6a7-6d9aab368edf tempest-ProjectReaderTests-330204430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.283s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-65f3ffed-49b2-44b9-b6a7-6d9aab368edf tempest-ProjectReaderTests-330204430 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:20 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-65f3ffed-49b2-44b9-b6a7-6d9aab368edf tempest-ProjectReaderTests-330204430 None] Deleted volume successfully. Sep 25 17:24:20 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-790849e7-3307-42e7-a7f4-c38ca3c11bc6 tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd" returned: 0 in 0.439s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-790849e7-3307-42e7-a7f4-c38ca3c11bc6 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:20 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e 1G Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-65f3ffed-49b2-44b9-b6a7-6d9aab368edf tempest-ProjectReaderTests-330204430 None] Lock "cinder-6ff52aca-cc3f-4043-86c9-06d6328f9796-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:20 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Flow 'volume_create_manager' (29785428-d64f-4700-a57e-3a75ccd613df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab09a8b-f6f8-4e15-9dd3-3964bcbceb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab09a8b-f6f8-4e15-9dd3-3964bcbceb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1416513740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2edc840e-344b-4ead-bf15-871718f78944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a9728775254468a03d6b90bc00069d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:21Z,use_quota=True,user_id='19c5d266957c4aa994c1c274ce094045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5386b657-ee2d-44f8-913e-439b7434f3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5386b657-ee2d-44f8-913e-439b7434f3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9e87a6-844b-4640-95f6-1a2d6d842c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:20 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9e87a6-844b-4640-95f6-1a2d6d842c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2edc840e-344b-4ead-bf15-871718f78944', 'volume_name': 'volume-2edc840e-344b-4ead-bf15-871718f78944', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a360a1-e101-40e8-8551-9109c7962996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a360a1-e101-40e8-8551-9109c7962996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932f893f-3c45-4636-9077-a23602a37d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:20 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Volume 2edc840e-344b-4ead-bf15-871718f78944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2edc840e-344b-4ead-bf15-871718f78944', 'volume_size': 1} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-790849e7-3307-42e7-a7f4-c38ca3c11bc6 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e 1G" returned: 0 in 0.495s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-790849e7-3307-42e7-a7f4-c38ca3c11bc6 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-217f0e60-47a0-46d7-b55c-654bd199fdfd -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:20 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-217f0e60-47a0-46d7-b55c-654bd199fdfd -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e Sep 25 17:24:20 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:21 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-790849e7-3307-42e7-a7f4-c38ca3c11bc6 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-217f0e60-47a0-46d7-b55c-654bd199fdfd -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e" returned: 0 in 0.320s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:21 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-790849e7-3307-42e7-a7f4-c38ca3c11bc6 tempest-ProjectMemberTests-1497756053 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e is being set with open permissions: ugo+rw Sep 25 17:24:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-790849e7-3307-42e7-a7f4-c38ca3c11bc6 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:21 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e Sep 25 17:24:21 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:21 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-790849e7-3307-42e7-a7f4-c38ca3c11bc6 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e" returned: 0 in 0.259s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-790849e7-3307-42e7-a7f4-c38ca3c11bc6 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:21 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.info Sep 25 17:24:21 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:21 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-790849e7-3307-42e7-a7f4-c38ca3c11bc6 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.info" returned: 0 in 0.259s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:21 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-790849e7-3307-42e7-a7f4-c38ca3c11bc6 tempest-ProjectMemberTests-1497756053 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.info is being set with open permissions: ugo+rw Sep 25 17:24:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-790849e7-3307-42e7-a7f4-c38ca3c11bc6 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:21 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.info Sep 25 17:24:21 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:22 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-790849e7-3307-42e7-a7f4-c38ca3c11bc6 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.info" returned: 0 in 0.251s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-790849e7-3307-42e7-a7f4-c38ca3c11bc6 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.167s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.937s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-636312627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138dc40c-f098-4ae2-b589-9e5482c863a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b8a542aaf842a6bb50594d57f8fd78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:17Z,use_quota=True,user_id='b740ac554694435ebc3baf8b86d0f6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Creating volume 138dc40c-f098-4ae2-b589-9e5482c863a3 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:22 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-138dc40c-f098-4ae2-b589-9e5482c863a3 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:22 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-138dc40c-f098-4ae2-b589-9e5482c863a3 1073741824 Sep 25 17:24:22 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:22 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-790849e7-3307-42e7-a7f4-c38ca3c11bc6 tempest-ProjectMemberTests-1497756053 None] Create snapshot completed successfully Sep 25 17:24:22 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-138dc40c-f098-4ae2-b589-9e5482c863a3 1073741824" returned: 0 in 0.458s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-138dc40c-f098-4ae2-b589-9e5482c863a3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:22 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-138dc40c-f098-4ae2-b589-9e5482c863a3 Sep 25 17:24:22 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b932f3a5-929c-4523-be1c-29e66815591d tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b932f3a5-929c-4523-be1c-29e66815591d tempest-ProjectMemberTests-1497756053 None] Lock "cinder-a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b932f3a5-929c-4523-be1c-29e66815591d tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-217f0e60-47a0-46d7-b55c-654bd199fdfd" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b932f3a5-929c-4523-be1c-29e66815591d tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-217f0e60-47a0-46d7-b55c-654bd199fdfd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b932f3a5-929c-4523-be1c-29e66815591d tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b932f3a5-929c-4523-be1c-29e66815591d tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b932f3a5-929c-4523-be1c-29e66815591d tempest-ProjectMemberTests-1497756053 None] Deleting offline snapshot a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e of volume 217f0e60-47a0-46d7-b55c-654bd199fdfd {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b932f3a5-929c-4523-be1c-29e66815591d tempest-ProjectMemberTests-1497756053 None] snapshot_file for this snap is: volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d06ffe-e051-4152-88e4-71ade51861c9]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b932f3a5-929c-4523-be1c-29e66815591d tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:22 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-138dc40c-f098-4ae2-b589-9e5482c863a3" returned: 0 in 0.296s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.295s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03423c4e-5777-4d69-a1d7-bbc9fa1929f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aedf0c5fa36144ea875e1f673b74ff79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:17Z,use_quota=True,user_id='36061ac304a047c7b966a318f3db1746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Creating volume 03423c4e-5777-4d69-a1d7-bbc9fa1929f5 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:22 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-03423c4e-5777-4d69-a1d7-bbc9fa1929f5 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0273f78-850e-4b7b-8918-9a6bb954fa09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-138dc40c-f098-4ae2-b589-9e5482c863a3', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:22 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-03423c4e-5777-4d69-a1d7-bbc9fa1929f5 1073741824 Sep 25 17:24:22 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9e7774-4e42-4869-abbf-404091b0de8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:22 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Volume volume-138dc40c-f098-4ae2-b589-9e5482c863a3 (138dc40c-f098-4ae2-b589-9e5482c863a3): created successfully Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9e7774-4e42-4869-abbf-404091b0de8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Flow 'volume_create_manager' (db235d65-0802-4af9-b496-edaf994e4eca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:23 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-9acdae89-f128-4a12-9e51-a4681ab1562e tempest-CreateVolumesFromSnapshotTest-1396798611 None] Created volume successfully. Sep 25 17:24:23 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e Sep 25 17:24:23 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:23 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b932f3a5-929c-4523-be1c-29e66815591d tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e" returned: 0 in 0.399s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b932f3a5-929c-4523-be1c-29e66815591d tempest-ProjectMemberTests-1497756053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-217f0e60-47a0-46d7-b55c-654bd199fdfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f906a19-aa8a-4f35-b326-4d79d938bea9]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b932f3a5-929c-4523-be1c-29e66815591d tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:23 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-03423c4e-5777-4d69-a1d7-bbc9fa1929f5 1073741824" returned: 0 in 0.446s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-03423c4e-5777-4d69-a1d7-bbc9fa1929f5 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:23 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-03423c4e-5777-4d69-a1d7-bbc9fa1929f5 Sep 25 17:24:23 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:23 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd Sep 25 17:24:23 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:23 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-03423c4e-5777-4d69-a1d7-bbc9fa1929f5" returned: 0 in 0.285s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.745s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1416513740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2edc840e-344b-4ead-bf15-871718f78944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a9728775254468a03d6b90bc00069d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:21Z,use_quota=True,user_id='19c5d266957c4aa994c1c274ce094045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Creating volume 2edc840e-344b-4ead-bf15-871718f78944 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:23 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2edc840e-344b-4ead-bf15-871718f78944 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:23 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:23 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2edc840e-344b-4ead-bf15-871718f78944 1073741824 Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-956df47f-9024-48e7-aae9-4ecc151d4536 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "cinder-138dc40c-f098-4ae2-b589-9e5482c863a3-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:23 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b932f3a5-929c-4523-be1c-29e66815591d tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd" returned: 0 in 0.441s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b932f3a5-929c-4523-be1c-29e66815591d tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e336d57-b0b7-40bb-85a3-cec18988fa13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03423c4e-5777-4d69-a1d7-bbc9fa1929f5', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e3b374-4193-4b9a-ba2a-ab6a13099650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:23 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e Sep 25 17:24:23 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-956df47f-9024-48e7-aae9-4ecc151d4536 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-138dc40c-f098-4ae2-b589-9e5482c863a3-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:23 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Volume volume-03423c4e-5777-4d69-a1d7-bbc9fa1929f5 (03423c4e-5777-4d69-a1d7-bbc9fa1929f5): created successfully Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e3b374-4193-4b9a-ba2a-ab6a13099650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Flow 'volume_create_manager' (fe6ecb46-1222-4c3a-b653-d93bef46ce1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:23 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-160c3a5e-7613-42e0-8c7c-e75181862b02 tempest-CinderUnicodeTest-1861901023 None] Created volume successfully. Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-956df47f-9024-48e7-aae9-4ecc151d4536 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "cinder-quobyte-138dc40c-f098-4ae2-b589-9e5482c863a3" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-956df47f-9024-48e7-aae9-4ecc151d4536 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-quobyte-138dc40c-f098-4ae2-b589-9e5482c863a3" acquired by "delete_volume" :: waited 0.031s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d273bcd9-5e45-4c4e-855a-df084761c5b3]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-956df47f-9024-48e7-aae9-4ecc151d4536 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-138dc40c-f098-4ae2-b589-9e5482c863a3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:24 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-138dc40c-f098-4ae2-b589-9e5482c863a3 Sep 25 17:24:24 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:24 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b932f3a5-929c-4523-be1c-29e66815591d tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e" returned: 0 in 0.468s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b932f3a5-929c-4523-be1c-29e66815591d tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:24 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e Sep 25 17:24:24 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:24 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2edc840e-344b-4ead-bf15-871718f78944 1073741824" returned: 0 in 0.608s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2edc840e-344b-4ead-bf15-871718f78944 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:24 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2edc840e-344b-4ead-bf15-871718f78944 Sep 25 17:24:24 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:24 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-956df47f-9024-48e7-aae9-4ecc151d4536 tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-138dc40c-f098-4ae2-b589-9e5482c863a3" returned: 0 in 0.443s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-956df47f-9024-48e7-aae9-4ecc151d4536 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-138dc40c-f098-4ae2-b589-9e5482c863a3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:24 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-138dc40c-f098-4ae2-b589-9e5482c863a3 Sep 25 17:24:24 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:24 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b932f3a5-929c-4523-be1c-29e66815591d tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd.a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e" returned: 0 in 0.317s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b932f3a5-929c-4523-be1c-29e66815591d tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e" released by "_delete_snapshot" :: held 1.754s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b932f3a5-929c-4523-be1c-29e66815591d tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-217f0e60-47a0-46d7-b55c-654bd199fdfd" released by "delete_snapshot" :: held 1.779s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:24 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2edc840e-344b-4ead-bf15-871718f78944" returned: 0 in 0.287s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932f893f-3c45-4636-9077-a23602a37d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2edc840e-344b-4ead-bf15-871718f78944', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9005f8-9923-4ad1-b4eb-1e46ff4fb0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-b932f3a5-929c-4523-be1c-29e66815591d tempest-ProjectMemberTests-1497756053 None] Created reservations ['e65f4c4e-baac-4b5a-a04b-bcef355c5146', '0b76b67a-f8e9-47c4-942d-41f7947ec8b0', '882f1a1f-4df8-42c5-8544-0ec840763867', '04210b87-20cd-4e3b-a267-3014a114e03a'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:24 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-956df47f-9024-48e7-aae9-4ecc151d4536 tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-138dc40c-f098-4ae2-b589-9e5482c863a3" returned: 0 in 0.286s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:24 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Volume volume-2edc840e-344b-4ead-bf15-871718f78944 (2edc840e-344b-4ead-bf15-871718f78944): created successfully Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9005f8-9923-4ad1-b4eb-1e46ff4fb0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Flow 'volume_create_manager' (29785428-d64f-4700-a57e-3a75ccd613df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-956df47f-9024-48e7-aae9-4ecc151d4536 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-quobyte-138dc40c-f098-4ae2-b589-9e5482c863a3" released by "delete_volume" :: held 0.808s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:24 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-348f9cc0-3aa4-4d87-a5cb-66b82959e6ca tempest-ProjectReaderTests-330204430 None] Created volume successfully. Sep 25 17:24:24 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b932f3a5-929c-4523-be1c-29e66815591d tempest-ProjectMemberTests-1497756053 None] Delete snapshot completed successfully. Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-b932f3a5-929c-4523-be1c-29e66815591d tempest-ProjectMemberTests-1497756053 None] Lock "cinder-a46a1cdd-59fc-43e9-a13c-e2c0cf5f100e-delete_snapshot" released by "delete_snapshot" :: held 1.995s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-956df47f-9024-48e7-aae9-4ecc151d4536 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Created reservations ['67933e4d-b1ec-4385-b31b-5a8235f4caa5', '6e6df42e-336e-4a18-83f9-dcecbd0233a7', 'f5c2de58-1dd6-4c18-8bf3-2cfa9d6562df', '0a05411b-64f6-468f-9653-88899cb6e349'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-956df47f-9024-48e7-aae9-4ecc151d4536 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-956df47f-9024-48e7-aae9-4ecc151d4536 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-956df47f-9024-48e7-aae9-4ecc151d4536 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-956df47f-9024-48e7-aae9-4ecc151d4536 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-956df47f-9024-48e7-aae9-4ecc151d4536 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-956df47f-9024-48e7-aae9-4ecc151d4536 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:24 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:24 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ca91e81e-d822-46d4-9a65-0bcce67e9cca tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "cinder-46f66ac5-cedd-4bc7-8204-328470519de4-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ca91e81e-d822-46d4-9a65-0bcce67e9cca tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-46f66ac5-cedd-4bc7-8204-328470519de4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ca91e81e-d822-46d4-9a65-0bcce67e9cca tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "cinder-quobyte-46f66ac5-cedd-4bc7-8204-328470519de4" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-74a0e45c-3f39-4c59-818e-bfb92e474bc8 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-217f0e60-47a0-46d7-b55c-654bd199fdfd-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ca91e81e-d822-46d4-9a65-0bcce67e9cca tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-quobyte-46f66ac5-cedd-4bc7-8204-328470519de4" acquired by "delete_volume" :: waited 0.051s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-74a0e45c-3f39-4c59-818e-bfb92e474bc8 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-217f0e60-47a0-46d7-b55c-654bd199fdfd-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b10e04a-1195-480c-bc4b-36295a727626]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ca91e81e-d822-46d4-9a65-0bcce67e9cca tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46f66ac5-cedd-4bc7-8204-328470519de4 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-74a0e45c-3f39-4c59-818e-bfb92e474bc8 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-217f0e60-47a0-46d7-b55c-654bd199fdfd" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-74a0e45c-3f39-4c59-818e-bfb92e474bc8 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-217f0e60-47a0-46d7-b55c-654bd199fdfd" acquired by "delete_volume" :: waited 0.030s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:25 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-956df47f-9024-48e7-aae9-4ecc151d4536 tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.438s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-956df47f-9024-48e7-aae9-4ecc151d4536 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:25 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-956df47f-9024-48e7-aae9-4ecc151d4536 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Deleted volume successfully. Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0cf51d-803a-4d56-a4e6-fb0c594453a0]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-74a0e45c-3f39-4c59-818e-bfb92e474bc8 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:25 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46f66ac5-cedd-4bc7-8204-328470519de4 Sep 25 17:24:25 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6021a579-ee06-45f7-b5b8-956baf3df0b1 tempest-ProjectReaderTests-330204430 None] Acquiring lock "cinder-2edc840e-344b-4ead-bf15-871718f78944-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-956df47f-9024-48e7-aae9-4ecc151d4536 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-138dc40c-f098-4ae2-b589-9e5482c863a3-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6021a579-ee06-45f7-b5b8-956baf3df0b1 tempest-ProjectReaderTests-330204430 None] Lock "cinder-2edc840e-344b-4ead-bf15-871718f78944-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6021a579-ee06-45f7-b5b8-956baf3df0b1 tempest-ProjectReaderTests-330204430 None] Acquiring lock "cinder-quobyte-2edc840e-344b-4ead-bf15-871718f78944" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6021a579-ee06-45f7-b5b8-956baf3df0b1 tempest-ProjectReaderTests-330204430 None] Lock "cinder-quobyte-2edc840e-344b-4ead-bf15-871718f78944" acquired by "delete_volume" :: waited 0.024s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:25 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd Sep 25 17:24:25 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bba5d55-43a0-4e44-8ebf-5ea71bc687ea]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6021a579-ee06-45f7-b5b8-956baf3df0b1 tempest-ProjectReaderTests-330204430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2edc840e-344b-4ead-bf15-871718f78944 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:25 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2edc840e-344b-4ead-bf15-871718f78944 Sep 25 17:24:25 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:25 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ca91e81e-d822-46d4-9a65-0bcce67e9cca tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46f66ac5-cedd-4bc7-8204-328470519de4" returned: 0 in 0.597s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ca91e81e-d822-46d4-9a65-0bcce67e9cca tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46f66ac5-cedd-4bc7-8204-328470519de4 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:25 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46f66ac5-cedd-4bc7-8204-328470519de4 Sep 25 17:24:25 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:25 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-74a0e45c-3f39-4c59-818e-bfb92e474bc8 tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd" returned: 0 in 0.516s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-74a0e45c-3f39-4c59-818e-bfb92e474bc8 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:25 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd Sep 25 17:24:25 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:25 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:26 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Flow 'volume_create_manager' (bc9fd194-ae27-4d41-9bbc-34be5d2f2b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab605382-d639-44e0-a254-e944da08d9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6021a579-ee06-45f7-b5b8-956baf3df0b1 tempest-ProjectReaderTests-330204430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2edc840e-344b-4ead-bf15-871718f78944" returned: 0 in 0.499s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6021a579-ee06-45f7-b5b8-956baf3df0b1 tempest-ProjectReaderTests-330204430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2edc840e-344b-4ead-bf15-871718f78944 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:26 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2edc840e-344b-4ead-bf15-871718f78944 Sep 25 17:24:26 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab605382-d639-44e0-a254-e944da08d9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-830374313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd327b3f-0794-4e2a-9e63-2455556932ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aedf0c5fa36144ea875e1f673b74ff79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:26Z,use_quota=True,user_id='36061ac304a047c7b966a318f3db1746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5841159f-f77c-418e-8fe2-06bc30326d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5841159f-f77c-418e-8fe2-06bc30326d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19be10e-54b3-4e75-aa7c-3561ef862922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19be10e-54b3-4e75-aa7c-3561ef862922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd327b3f-0794-4e2a-9e63-2455556932ef', 'volume_name': 'volume-fd327b3f-0794-4e2a-9e63-2455556932ef', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b72055b-1ccb-4631-9bd1-ebf6411335eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b72055b-1ccb-4631-9bd1-ebf6411335eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876d73a7-43c3-4207-8cbb-a0cd451eca22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:26 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Volume fd327b3f-0794-4e2a-9e63-2455556932ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd327b3f-0794-4e2a-9e63-2455556932ef', 'volume_size': 1} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:26 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-830374313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd327b3f-0794-4e2a-9e63-2455556932ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aedf0c5fa36144ea875e1f673b74ff79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:26Z,use_quota=True,user_id='36061ac304a047c7b966a318f3db1746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Creating volume fd327b3f-0794-4e2a-9e63-2455556932ef {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:26 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ca91e81e-d822-46d4-9a65-0bcce67e9cca tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46f66ac5-cedd-4bc7-8204-328470519de4" returned: 0 in 0.356s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:26 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef 1073741824 Sep 25 17:24:26 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ca91e81e-d822-46d4-9a65-0bcce67e9cca tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-quobyte-46f66ac5-cedd-4bc7-8204-328470519de4" released by "delete_volume" :: held 1.043s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:26 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-74a0e45c-3f39-4c59-818e-bfb92e474bc8 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-217f0e60-47a0-46d7-b55c-654bd199fdfd" returned: 0 in 0.324s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-74a0e45c-3f39-4c59-818e-bfb92e474bc8 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-217f0e60-47a0-46d7-b55c-654bd199fdfd" released by "delete_volume" :: held 0.956s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-ca91e81e-d822-46d4-9a65-0bcce67e9cca tempest-CreateVolumesFromSnapshotTest-1396798611 None] Created reservations ['41b779f4-2424-43bf-958a-6613a484b128', 'f3351e65-e9c1-4b60-8166-6eb48c6df39a', '4f3ff44e-c6d4-408f-9b92-e6f89ce05446', '8533ec15-6d9a-427a-ace7-29c263cb38c3'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-74a0e45c-3f39-4c59-818e-bfb92e474bc8 tempest-ProjectMemberTests-1497756053 None] Created reservations ['7f48459c-7982-47f1-9d6c-07de1933a18e', 'db1fe910-9dcd-440c-a1b8-372e2000782d', '55f2d9bf-8be1-414a-a753-d3a17c5ffdde', '9e8b3b65-70c4-4f65-ae00-754272a8aa7f'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:26 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6021a579-ee06-45f7-b5b8-956baf3df0b1 tempest-ProjectReaderTests-330204430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-2edc840e-344b-4ead-bf15-871718f78944" returned: 0 in 0.302s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6021a579-ee06-45f7-b5b8-956baf3df0b1 tempest-ProjectReaderTests-330204430 None] Lock "cinder-quobyte-2edc840e-344b-4ead-bf15-871718f78944" released by "delete_volume" :: held 0.854s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ca91e81e-d822-46d4-9a65-0bcce67e9cca tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ca91e81e-d822-46d4-9a65-0bcce67e9cca tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ca91e81e-d822-46d4-9a65-0bcce67e9cca tempest-CreateVolumesFromSnapshotTest-1396798611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-ca91e81e-d822-46d4-9a65-0bcce67e9cca tempest-CreateVolumesFromSnapshotTest-1396798611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-ca91e81e-d822-46d4-9a65-0bcce67e9cca tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ca91e81e-d822-46d4-9a65-0bcce67e9cca tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:26 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:26 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-74a0e45c-3f39-4c59-818e-bfb92e474bc8 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-74a0e45c-3f39-4c59-818e-bfb92e474bc8 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-74a0e45c-3f39-4c59-818e-bfb92e474bc8 tempest-ProjectMemberTests-1497756053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-74a0e45c-3f39-4c59-818e-bfb92e474bc8 tempest-ProjectMemberTests-1497756053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-74a0e45c-3f39-4c59-818e-bfb92e474bc8 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-74a0e45c-3f39-4c59-818e-bfb92e474bc8 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-6021a579-ee06-45f7-b5b8-956baf3df0b1 tempest-ProjectReaderTests-330204430 None] Created reservations ['a247014a-2f27-48be-b592-a96cd9f9df8a', '77beda21-d1e6-41aa-b1ff-4bc7dc7e4f44', '61199fd7-32ee-44e5-b1ac-09ba5a0e18c4', 'a9544f80-31e0-4c1d-8792-2abef3f54f41'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:26 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:26 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6021a579-ee06-45f7-b5b8-956baf3df0b1 tempest-ProjectReaderTests-330204430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6021a579-ee06-45f7-b5b8-956baf3df0b1 tempest-ProjectReaderTests-330204430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6021a579-ee06-45f7-b5b8-956baf3df0b1 tempest-ProjectReaderTests-330204430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6021a579-ee06-45f7-b5b8-956baf3df0b1 tempest-ProjectReaderTests-330204430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6021a579-ee06-45f7-b5b8-956baf3df0b1 tempest-ProjectReaderTests-330204430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6021a579-ee06-45f7-b5b8-956baf3df0b1 tempest-ProjectReaderTests-330204430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:26 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:26 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:26 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef 1073741824" returned: 0 in 0.597s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:26 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-ca91e81e-d822-46d4-9a65-0bcce67e9cca tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.336s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-ca91e81e-d822-46d4-9a65-0bcce67e9cca tempest-CreateVolumesFromSnapshotTest-1396798611 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:26 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-ca91e81e-d822-46d4-9a65-0bcce67e9cca tempest-CreateVolumesFromSnapshotTest-1396798611 None] Deleted volume successfully. Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-ca91e81e-d822-46d4-9a65-0bcce67e9cca tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-46f66ac5-cedd-4bc7-8204-328470519de4-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:26 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-74a0e45c-3f39-4c59-818e-bfb92e474bc8 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.346s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-74a0e45c-3f39-4c59-818e-bfb92e474bc8 tempest-ProjectMemberTests-1497756053 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:26 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef Sep 25 17:24:26 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:26 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-74a0e45c-3f39-4c59-818e-bfb92e474bc8 tempest-ProjectMemberTests-1497756053 None] Deleted volume successfully. Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-74a0e45c-3f39-4c59-818e-bfb92e474bc8 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-217f0e60-47a0-46d7-b55c-654bd199fdfd-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:26 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6021a579-ee06-45f7-b5b8-956baf3df0b1 tempest-ProjectReaderTests-330204430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.292s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-6021a579-ee06-45f7-b5b8-956baf3df0b1 tempest-ProjectReaderTests-330204430 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:26 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-6021a579-ee06-45f7-b5b8-956baf3df0b1 tempest-ProjectReaderTests-330204430 None] Deleted volume successfully. Sep 25 17:24:26 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6021a579-ee06-45f7-b5b8-956baf3df0b1 tempest-ProjectReaderTests-330204430 None] Lock "cinder-2edc840e-344b-4ead-bf15-871718f78944-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:27 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef" returned: 0 in 0.280s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876d73a7-43c3-4207-8cbb-a0cd451eca22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd327b3f-0794-4e2a-9e63-2455556932ef', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b238948-4b07-4139-91ae-d02cc7161702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:27 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Volume volume-fd327b3f-0794-4e2a-9e63-2455556932ef (fd327b3f-0794-4e2a-9e63-2455556932ef): created successfully Sep 25 17:24:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b238948-4b07-4139-91ae-d02cc7161702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Flow 'volume_create_manager' (bc9fd194-ae27-4d41-9bbc-34be5d2f2b76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:27 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-f9a4715d-05fc-4e90-87c7-61f9229fb8b7 tempest-CinderUnicodeTest-1861901023 None] Created volume successfully. Sep 25 17:24:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fadd0fbb-67fa-434a-a667-1a7e082b7615 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "cinder-7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fadd0fbb-67fa-434a-a667-1a7e082b7615 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fadd0fbb-67fa-434a-a667-1a7e082b7615 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "cinder-quobyte-7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fadd0fbb-67fa-434a-a667-1a7e082b7615 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-quobyte-7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc" acquired by "delete_volume" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:27 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16da339-2362-4652-8827-5018c9ea9bef]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fadd0fbb-67fa-434a-a667-1a7e082b7615 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:27 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc Sep 25 17:24:27 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:27 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fadd0fbb-67fa-434a-a667-1a7e082b7615 tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc" returned: 0 in 0.404s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fadd0fbb-67fa-434a-a667-1a7e082b7615 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:27 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc Sep 25 17:24:27 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:27 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Flow 'volume_create_manager' (35e13fc1-0ae9-40bb-9499-e63df77217c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67861c45-d8bd-4602-b71f-adb3a6f21dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67861c45-d8bd-4602-b71f-adb3a6f21dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-911437493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46689a85-53ca-4670-aca8-06a6bca42f83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31fdfb42d1d48219cd53e16d4a0131f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:28Z,use_quota=True,user_id='645f5007ad61465e9de1ac84410dacf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce09d3cf-9cc3-4175-bf7c-475ffe7f6bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:27 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce09d3cf-9cc3-4175-bf7c-475ffe7f6bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e012a5b2-568f-49df-b1a8-3c7e76061984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e012a5b2-568f-49df-b1a8-3c7e76061984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46689a85-53ca-4670-aca8-06a6bca42f83', 'volume_name': 'volume-46689a85-53ca-4670-aca8-06a6bca42f83', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96dd01e4-86bc-4998-9681-efa59ab2f4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96dd01e4-86bc-4998-9681-efa59ab2f4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae430167-610c-4555-b274-2a1d961f9d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:28 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Volume 46689a85-53ca-4670-aca8-06a6bca42f83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46689a85-53ca-4670-aca8-06a6bca42f83', 'volume_size': 1} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-911437493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46689a85-53ca-4670-aca8-06a6bca42f83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31fdfb42d1d48219cd53e16d4a0131f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:28Z,use_quota=True,user_id='645f5007ad61465e9de1ac84410dacf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Creating volume 46689a85-53ca-4670-aca8-06a6bca42f83 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:28 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fadd0fbb-67fa-434a-a667-1a7e082b7615 tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc" returned: 0 in 0.368s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:28 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83 1073741824 Sep 25 17:24:28 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fadd0fbb-67fa-434a-a667-1a7e082b7615 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-quobyte-7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc" released by "delete_volume" :: held 0.826s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-fadd0fbb-67fa-434a-a667-1a7e082b7615 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Created reservations ['f32eed60-fcdc-4d8e-844b-cfa25f767f7e', 'b0244b02-abae-4dda-858f-e4ca2df83bc4', '40e54eda-e108-4bee-a6d2-5b43e4c6bffd', '669892d0-2a42-4202-b8bf-c3f6f3f71203'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-fadd0fbb-67fa-434a-a667-1a7e082b7615 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-fadd0fbb-67fa-434a-a667-1a7e082b7615 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-fadd0fbb-67fa-434a-a667-1a7e082b7615 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-fadd0fbb-67fa-434a-a667-1a7e082b7615 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-fadd0fbb-67fa-434a-a667-1a7e082b7615 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fadd0fbb-67fa-434a-a667-1a7e082b7615 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:28 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:28 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f34489c3-54d5-4c9b-bcbd-fadb1152caf4 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "cinder-cfa88f85-b65d-4f2d-b905-21d8aab75411-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f34489c3-54d5-4c9b-bcbd-fadb1152caf4 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-cfa88f85-b65d-4f2d-b905-21d8aab75411-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7b9af052-5789-4401-9d99-f674f4defa05 tempest-CinderUnicodeTest-1861901023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f34489c3-54d5-4c9b-bcbd-fadb1152caf4 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "cinder-quobyte-cfa88f85-b65d-4f2d-b905-21d8aab75411" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f34489c3-54d5-4c9b-bcbd-fadb1152caf4 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-quobyte-cfa88f85-b65d-4f2d-b905-21d8aab75411" acquired by "delete_volume" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[387d44c2-7a1b-48f8-9ba1-9465bd7667ae]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f34489c3-54d5-4c9b-bcbd-fadb1152caf4 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cfa88f85-b65d-4f2d-b905-21d8aab75411 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:28 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:28 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83 1073741824" returned: 0 in 0.648s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fadd0fbb-67fa-434a-a667-1a7e082b7615 tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.419s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-fadd0fbb-67fa-434a-a667-1a7e082b7615 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:28 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cfa88f85-b65d-4f2d-b905-21d8aab75411 Sep 25 17:24:28 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:28 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-fadd0fbb-67fa-434a-a667-1a7e082b7615 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Deleted volume successfully. Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fadd0fbb-67fa-434a-a667-1a7e082b7615 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-7d2b6b4c-14b7-423c-a6ec-6fa990a7d8fc-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:28 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83 Sep 25 17:24:28 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:29 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f34489c3-54d5-4c9b-bcbd-fadb1152caf4 tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cfa88f85-b65d-4f2d-b905-21d8aab75411" returned: 0 in 0.471s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f34489c3-54d5-4c9b-bcbd-fadb1152caf4 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cfa88f85-b65d-4f2d-b905-21d8aab75411 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:29 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cfa88f85-b65d-4f2d-b905-21d8aab75411 Sep 25 17:24:29 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:29 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83" returned: 0 in 0.323s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7b9af052-5789-4401-9d99-f674f4defa05 tempest-CinderUnicodeTest-1861901023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.622s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae430167-610c-4555-b274-2a1d961f9d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46689a85-53ca-4670-aca8-06a6bca42f83', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b33c98f-f880-4a6b-a87e-63eb818ac1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-7b9af052-5789-4401-9d99-f674f4defa05 tempest-CinderUnicodeTest-1861901023 None] Creating offline snapshot 3643867d-b01a-4942-a65b-8796ed2cc2fa of volume fd327b3f-0794-4e2a-9e63-2455556932ef {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:24:29 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Volume volume-46689a85-53ca-4670-aca8-06a6bca42f83 (46689a85-53ca-4670-aca8-06a6bca42f83): created successfully Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b33c98f-f880-4a6b-a87e-63eb818ac1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Flow 'volume_create_manager' (35e13fc1-0ae9-40bb-9499-e63df77217c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4527eee-0a8a-4276-ae39-b02cbe013584]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7b9af052-5789-4401-9d99-f674f4defa05 tempest-CinderUnicodeTest-1861901023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:29 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-48001ca1-df18-473b-aba5-240e36982a9b tempest-ProjectMemberTests-1497756053 None] Created volume successfully. Sep 25 17:24:29 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef Sep 25 17:24:29 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:29 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f34489c3-54d5-4c9b-bcbd-fadb1152caf4 tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-cfa88f85-b65d-4f2d-b905-21d8aab75411" returned: 0 in 0.317s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f34489c3-54d5-4c9b-bcbd-fadb1152caf4 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-quobyte-cfa88f85-b65d-4f2d-b905-21d8aab75411" released by "delete_volume" :: held 0.848s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-f34489c3-54d5-4c9b-bcbd-fadb1152caf4 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Created reservations ['ad435f16-9ad5-4bd0-8dbd-4fea254b9d62', '63f72c02-096a-4814-a766-c96768aa882b', 'e45d4564-a93e-4314-8f9e-ef05e677203e', '84959ff7-6ee7-4634-a62c-341cc7793337'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f34489c3-54d5-4c9b-bcbd-fadb1152caf4 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f34489c3-54d5-4c9b-bcbd-fadb1152caf4 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f34489c3-54d5-4c9b-bcbd-fadb1152caf4 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f34489c3-54d5-4c9b-bcbd-fadb1152caf4 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f34489c3-54d5-4c9b-bcbd-fadb1152caf4 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f34489c3-54d5-4c9b-bcbd-fadb1152caf4 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:29 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:29 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:29 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-64e193ce-8ed0-4215-bf98-517766c1b457 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "cinder-40348ca9-b1da-4903-be52-150fb6174559-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7b9af052-5789-4401-9d99-f674f4defa05 tempest-CinderUnicodeTest-1861901023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef" returned: 0 in 0.496s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7b9af052-5789-4401-9d99-f674f4defa05 tempest-CinderUnicodeTest-1861901023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.3643867d-b01a-4942-a65b-8796ed2cc2fa 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-64e193ce-8ed0-4215-bf98-517766c1b457 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-40348ca9-b1da-4903-be52-150fb6174559-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:29 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.3643867d-b01a-4942-a65b-8796ed2cc2fa 1G Sep 25 17:24:29 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-64e193ce-8ed0-4215-bf98-517766c1b457 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "cinder-quobyte-40348ca9-b1da-4903-be52-150fb6174559" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-64e193ce-8ed0-4215-bf98-517766c1b457 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-quobyte-40348ca9-b1da-4903-be52-150fb6174559" acquired by "delete_volume" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[2160ba96-d732-431e-9044-b359781c2d0e]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-64e193ce-8ed0-4215-bf98-517766c1b457 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-40348ca9-b1da-4903-be52-150fb6174559 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:29 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f34489c3-54d5-4c9b-bcbd-fadb1152caf4 tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.413s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:29 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-f34489c3-54d5-4c9b-bcbd-fadb1152caf4 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:29 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-f34489c3-54d5-4c9b-bcbd-fadb1152caf4 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Deleted volume successfully. Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f34489c3-54d5-4c9b-bcbd-fadb1152caf4 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-cfa88f85-b65d-4f2d-b905-21d8aab75411-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:30 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-40348ca9-b1da-4903-be52-150fb6174559 Sep 25 17:24:30 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4bbe23e8-bc74-4230-a25e-dd32cacb84ad tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:30 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7b9af052-5789-4401-9d99-f674f4defa05 tempest-CinderUnicodeTest-1861901023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.3643867d-b01a-4942-a65b-8796ed2cc2fa 1G" returned: 0 in 0.673s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7b9af052-5789-4401-9d99-f674f4defa05 tempest-CinderUnicodeTest-1861901023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd327b3f-0794-4e2a-9e63-2455556932ef -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.3643867d-b01a-4942-a65b-8796ed2cc2fa {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:30 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-64e193ce-8ed0-4215-bf98-517766c1b457 tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-40348ca9-b1da-4903-be52-150fb6174559" returned: 0 in 0.479s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-64e193ce-8ed0-4215-bf98-517766c1b457 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-40348ca9-b1da-4903-be52-150fb6174559 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:30 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd327b3f-0794-4e2a-9e63-2455556932ef -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.3643867d-b01a-4942-a65b-8796ed2cc2fa Sep 25 17:24:30 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:30 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-40348ca9-b1da-4903-be52-150fb6174559 Sep 25 17:24:30 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:30 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-64e193ce-8ed0-4215-bf98-517766c1b457 tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-40348ca9-b1da-4903-be52-150fb6174559" returned: 0 in 0.246s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-64e193ce-8ed0-4215-bf98-517766c1b457 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-quobyte-40348ca9-b1da-4903-be52-150fb6174559" released by "delete_volume" :: held 0.781s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:30 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7b9af052-5789-4401-9d99-f674f4defa05 tempest-CinderUnicodeTest-1861901023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd327b3f-0794-4e2a-9e63-2455556932ef -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.3643867d-b01a-4942-a65b-8796ed2cc2fa" returned: 0 in 0.299s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:30 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-7b9af052-5789-4401-9d99-f674f4defa05 tempest-CinderUnicodeTest-1861901023 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.3643867d-b01a-4942-a65b-8796ed2cc2fa is being set with open permissions: ugo+rw Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7b9af052-5789-4401-9d99-f674f4defa05 tempest-CinderUnicodeTest-1861901023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.3643867d-b01a-4942-a65b-8796ed2cc2fa {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:30 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.3643867d-b01a-4942-a65b-8796ed2cc2fa Sep 25 17:24:30 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-64e193ce-8ed0-4215-bf98-517766c1b457 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Created reservations ['da395b3e-af1a-452d-8456-079c7733c013', '64b8a719-c130-4af5-a6d4-79cb1cb0488c', '4e35ebc7-3ebb-4975-95ec-01a71bc66842', 'bfd1f797-4cd5-4d67-b422-ad5138b81825'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-64e193ce-8ed0-4215-bf98-517766c1b457 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-64e193ce-8ed0-4215-bf98-517766c1b457 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-64e193ce-8ed0-4215-bf98-517766c1b457 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-64e193ce-8ed0-4215-bf98-517766c1b457 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-64e193ce-8ed0-4215-bf98-517766c1b457 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-64e193ce-8ed0-4215-bf98-517766c1b457 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:30 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:30 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-62a3d352-c2eb-4ede-9bd7-08610bccd1ab tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "cinder-b3862d83-cb05-4043-964e-806034aa5cc8-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-62a3d352-c2eb-4ede-9bd7-08610bccd1ab tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-b3862d83-cb05-4043-964e-806034aa5cc8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-62a3d352-c2eb-4ede-9bd7-08610bccd1ab tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "cinder-quobyte-29632c25-89e3-4edd-92fb-e25fde51bb2e" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-62a3d352-c2eb-4ede-9bd7-08610bccd1ab tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-quobyte-29632c25-89e3-4edd-92fb-e25fde51bb2e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-62a3d352-c2eb-4ede-9bd7-08610bccd1ab tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "cinder-quobyte-b3862d83-cb05-4043-964e-806034aa5cc8" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-62a3d352-c2eb-4ede-9bd7-08610bccd1ab tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-quobyte-b3862d83-cb05-4043-964e-806034aa5cc8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-62a3d352-c2eb-4ede-9bd7-08610bccd1ab tempest-CreateVolumesFromSnapshotTest-1396798611 None] Deleting offline snapshot b3862d83-cb05-4043-964e-806034aa5cc8 of volume 29632c25-89e3-4edd-92fb-e25fde51bb2e {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:24:30 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-62a3d352-c2eb-4ede-9bd7-08610bccd1ab tempest-CreateVolumesFromSnapshotTest-1396798611 None] snapshot_file for this snap is: volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.b3862d83-cb05-4043-964e-806034aa5cc8 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7b9af052-5789-4401-9d99-f674f4defa05 tempest-CinderUnicodeTest-1861901023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.3643867d-b01a-4942-a65b-8796ed2cc2fa" returned: 0 in 0.295s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f997e6-3ddf-47f7-9a39-b2aa4fa6812d]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-62a3d352-c2eb-4ede-9bd7-08610bccd1ab tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.b3862d83-cb05-4043-964e-806034aa5cc8 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7b9af052-5789-4401-9d99-f674f4defa05 tempest-CinderUnicodeTest-1861901023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:31 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.info Sep 25 17:24:31 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:31 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-64e193ce-8ed0-4215-bf98-517766c1b457 tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.273s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:31 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-64e193ce-8ed0-4215-bf98-517766c1b457 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:31 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-64e193ce-8ed0-4215-bf98-517766c1b457 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Deleted volume successfully. Sep 25 17:24:31 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-64e193ce-8ed0-4215-bf98-517766c1b457 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-40348ca9-b1da-4903-be52-150fb6174559-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:31 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.b3862d83-cb05-4043-964e-806034aa5cc8 Sep 25 17:24:31 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:31 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7b9af052-5789-4401-9d99-f674f4defa05 tempest-CinderUnicodeTest-1861901023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.info" returned: 0 in 0.277s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:31 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-7b9af052-5789-4401-9d99-f674f4defa05 tempest-CinderUnicodeTest-1861901023 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.info is being set with open permissions: ugo+rw Sep 25 17:24:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7b9af052-5789-4401-9d99-f674f4defa05 tempest-CinderUnicodeTest-1861901023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:31 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.info Sep 25 17:24:31 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:31 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-62a3d352-c2eb-4ede-9bd7-08610bccd1ab tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.b3862d83-cb05-4043-964e-806034aa5cc8" returned: 0 in 0.415s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:31 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-62a3d352-c2eb-4ede-9bd7-08610bccd1ab tempest-CreateVolumesFromSnapshotTest-1396798611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29632c25-89e3-4edd-92fb-e25fde51bb2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:24:31 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6becdd57-dd1f-4f4a-b0cd-30a16aec3d00]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-62a3d352-c2eb-4ede-9bd7-08610bccd1ab tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:31 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e Sep 25 17:24:31 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:31 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7b9af052-5789-4401-9d99-f674f4defa05 tempest-CinderUnicodeTest-1861901023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.info" returned: 0 in 0.265s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7b9af052-5789-4401-9d99-f674f4defa05 tempest-CinderUnicodeTest-1861901023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.470s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4bbe23e8-bc74-4230-a25e-dd32cacb84ad tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.242s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:31 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-4bbe23e8-bc74-4230-a25e-dd32cacb84ad tempest-ProjectMemberTests-1497756053 None] Creating offline snapshot 2bf1437f-4b53-4756-b385-32dc04a43179 of volume 46689a85-53ca-4670-aca8-06a6bca42f83 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:24:31 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[28847f5c-c55a-4ed9-a84c-ecc7bf6d296f]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4bbe23e8-bc74-4230-a25e-dd32cacb84ad tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:31 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-7b9af052-5789-4401-9d99-f674f4defa05 tempest-CinderUnicodeTest-1861901023 None] Create snapshot completed successfully Sep 25 17:24:31 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83 Sep 25 17:24:31 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:31 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-62a3d352-c2eb-4ede-9bd7-08610bccd1ab tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e" returned: 0 in 0.383s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-62a3d352-c2eb-4ede-9bd7-08610bccd1ab tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.b3862d83-cb05-4043-964e-806034aa5cc8 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:31 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.b3862d83-cb05-4043-964e-806034aa5cc8 Sep 25 17:24:31 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:31 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4bbe23e8-bc74-4230-a25e-dd32cacb84ad tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83" returned: 0 in 0.394s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4bbe23e8-bc74-4230-a25e-dd32cacb84ad tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.2bf1437f-4b53-4756-b385-32dc04a43179 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:32 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.2bf1437f-4b53-4756-b385-32dc04a43179 1G Sep 25 17:24:32 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:32 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-62a3d352-c2eb-4ede-9bd7-08610bccd1ab tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.b3862d83-cb05-4043-964e-806034aa5cc8" returned: 0 in 0.357s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-62a3d352-c2eb-4ede-9bd7-08610bccd1ab tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.b3862d83-cb05-4043-964e-806034aa5cc8 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:32 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.b3862d83-cb05-4043-964e-806034aa5cc8 Sep 25 17:24:32 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:32 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:32 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-62a3d352-c2eb-4ede-9bd7-08610bccd1ab tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e.b3862d83-cb05-4043-964e-806034aa5cc8" returned: 0 in 0.289s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4bbe23e8-bc74-4230-a25e-dd32cacb84ad tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.2bf1437f-4b53-4756-b385-32dc04a43179 1G" returned: 0 in 0.444s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4bbe23e8-bc74-4230-a25e-dd32cacb84ad tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46689a85-53ca-4670-aca8-06a6bca42f83 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.2bf1437f-4b53-4756-b385-32dc04a43179 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:32 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46689a85-53ca-4670-aca8-06a6bca42f83 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.2bf1437f-4b53-4756-b385-32dc04a43179 Sep 25 17:24:32 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-62a3d352-c2eb-4ede-9bd7-08610bccd1ab tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-quobyte-b3862d83-cb05-4043-964e-806034aa5cc8" released by "_delete_snapshot" :: held 1.590s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-62a3d352-c2eb-4ede-9bd7-08610bccd1ab tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-quobyte-29632c25-89e3-4edd-92fb-e25fde51bb2e" released by "delete_snapshot" :: held 1.618s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:32 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-62a3d352-c2eb-4ede-9bd7-08610bccd1ab tempest-CreateVolumesFromSnapshotTest-1396798611 None] Created reservations ['47f4333b-7da2-4f25-8a0b-1dc8d0d38bd0', '2a003c95-505c-4175-89e3-aa354410e1af', '64cf66bc-68b3-4bc0-b258-eab1ed351670', 'f562e36b-6135-47f9-8a94-cbe85667a47f'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:32 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-62a3d352-c2eb-4ede-9bd7-08610bccd1ab tempest-CreateVolumesFromSnapshotTest-1396798611 None] Delete snapshot completed successfully. Sep 25 17:24:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-62a3d352-c2eb-4ede-9bd7-08610bccd1ab tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-b3862d83-cb05-4043-964e-806034aa5cc8-delete_snapshot" released by "delete_snapshot" :: held 1.801s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7bf5f739-dfc3-416f-ab1a-07fc90f23e5b tempest-CinderUnicodeTest-1861901023 None] Acquiring lock "cinder-3643867d-b01a-4942-a65b-8796ed2cc2fa-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7bf5f739-dfc3-416f-ab1a-07fc90f23e5b tempest-CinderUnicodeTest-1861901023 None] Lock "cinder-3643867d-b01a-4942-a65b-8796ed2cc2fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7bf5f739-dfc3-416f-ab1a-07fc90f23e5b tempest-CinderUnicodeTest-1861901023 None] Acquiring lock "cinder-quobyte-fd327b3f-0794-4e2a-9e63-2455556932ef" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7bf5f739-dfc3-416f-ab1a-07fc90f23e5b tempest-CinderUnicodeTest-1861901023 None] Lock "cinder-quobyte-fd327b3f-0794-4e2a-9e63-2455556932ef" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7bf5f739-dfc3-416f-ab1a-07fc90f23e5b tempest-CinderUnicodeTest-1861901023 None] Acquiring lock "cinder-quobyte-3643867d-b01a-4942-a65b-8796ed2cc2fa" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7bf5f739-dfc3-416f-ab1a-07fc90f23e5b tempest-CinderUnicodeTest-1861901023 None] Lock "cinder-quobyte-3643867d-b01a-4942-a65b-8796ed2cc2fa" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-7bf5f739-dfc3-416f-ab1a-07fc90f23e5b tempest-CinderUnicodeTest-1861901023 None] Deleting offline snapshot 3643867d-b01a-4942-a65b-8796ed2cc2fa of volume fd327b3f-0794-4e2a-9e63-2455556932ef {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:24:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-7bf5f739-dfc3-416f-ab1a-07fc90f23e5b tempest-CinderUnicodeTest-1861901023 None] snapshot_file for this snap is: volume-fd327b3f-0794-4e2a-9e63-2455556932ef.3643867d-b01a-4942-a65b-8796ed2cc2fa {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:24:32 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62d5ff4-fda8-4a0e-b223-7d19221f258b]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:32 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7bf5f739-dfc3-416f-ab1a-07fc90f23e5b tempest-CinderUnicodeTest-1861901023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.3643867d-b01a-4942-a65b-8796ed2cc2fa {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4bbe23e8-bc74-4230-a25e-dd32cacb84ad tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46689a85-53ca-4670-aca8-06a6bca42f83 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.2bf1437f-4b53-4756-b385-32dc04a43179" returned: 0 in 0.355s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:32 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-4bbe23e8-bc74-4230-a25e-dd32cacb84ad tempest-ProjectMemberTests-1497756053 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.2bf1437f-4b53-4756-b385-32dc04a43179 is being set with open permissions: ugo+rw Sep 25 17:24:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4bbe23e8-bc74-4230-a25e-dd32cacb84ad tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.2bf1437f-4b53-4756-b385-32dc04a43179 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:32 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.2bf1437f-4b53-4756-b385-32dc04a43179 Sep 25 17:24:32 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:32 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.3643867d-b01a-4942-a65b-8796ed2cc2fa Sep 25 17:24:32 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5127ee6f-e1a9-41f8-aa40-db357e342cf6 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "cinder-29632c25-89e3-4edd-92fb-e25fde51bb2e-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5127ee6f-e1a9-41f8-aa40-db357e342cf6 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-29632c25-89e3-4edd-92fb-e25fde51bb2e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5127ee6f-e1a9-41f8-aa40-db357e342cf6 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "cinder-quobyte-29632c25-89e3-4edd-92fb-e25fde51bb2e" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:33 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4bbe23e8-bc74-4230-a25e-dd32cacb84ad tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.2bf1437f-4b53-4756-b385-32dc04a43179" returned: 0 in 0.297s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5127ee6f-e1a9-41f8-aa40-db357e342cf6 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-quobyte-29632c25-89e3-4edd-92fb-e25fde51bb2e" acquired by "delete_volume" :: waited 0.023s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4bbe23e8-bc74-4230-a25e-dd32cacb84ad tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb5c6df-6568-4f36-8275-1f08680eee27]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5127ee6f-e1a9-41f8-aa40-db357e342cf6 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:33 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.info Sep 25 17:24:33 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:33 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7bf5f739-dfc3-416f-ab1a-07fc90f23e5b tempest-CinderUnicodeTest-1861901023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.3643867d-b01a-4942-a65b-8796ed2cc2fa" returned: 0 in 0.429s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-7bf5f739-dfc3-416f-ab1a-07fc90f23e5b tempest-CinderUnicodeTest-1861901023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd327b3f-0794-4e2a-9e63-2455556932ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fdbece-88d1-4d07-b654-53024aea5b14]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7bf5f739-dfc3-416f-ab1a-07fc90f23e5b tempest-CinderUnicodeTest-1861901023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:33 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e Sep 25 17:24:33 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:33 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef Sep 25 17:24:33 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:33 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4bbe23e8-bc74-4230-a25e-dd32cacb84ad tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.info" returned: 0 in 0.294s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:33 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-4bbe23e8-bc74-4230-a25e-dd32cacb84ad tempest-ProjectMemberTests-1497756053 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.info is being set with open permissions: ugo+rw Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4bbe23e8-bc74-4230-a25e-dd32cacb84ad tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:33 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.info Sep 25 17:24:33 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:33 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5127ee6f-e1a9-41f8-aa40-db357e342cf6 tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e" returned: 0 in 0.395s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5127ee6f-e1a9-41f8-aa40-db357e342cf6 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:33 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e Sep 25 17:24:33 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:33 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7bf5f739-dfc3-416f-ab1a-07fc90f23e5b tempest-CinderUnicodeTest-1861901023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef" returned: 0 in 0.402s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7bf5f739-dfc3-416f-ab1a-07fc90f23e5b tempest-CinderUnicodeTest-1861901023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.3643867d-b01a-4942-a65b-8796ed2cc2fa {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:33 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.3643867d-b01a-4942-a65b-8796ed2cc2fa Sep 25 17:24:33 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:33 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4bbe23e8-bc74-4230-a25e-dd32cacb84ad tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.info" returned: 0 in 0.278s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4bbe23e8-bc74-4230-a25e-dd32cacb84ad tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.196s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:33 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-4bbe23e8-bc74-4230-a25e-dd32cacb84ad tempest-ProjectMemberTests-1497756053 None] Create snapshot completed successfully Sep 25 17:24:33 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5127ee6f-e1a9-41f8-aa40-db357e342cf6 tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-29632c25-89e3-4edd-92fb-e25fde51bb2e" returned: 0 in 0.279s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5127ee6f-e1a9-41f8-aa40-db357e342cf6 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-quobyte-29632c25-89e3-4edd-92fb-e25fde51bb2e" released by "delete_volume" :: held 0.762s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-5127ee6f-e1a9-41f8-aa40-db357e342cf6 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Created reservations ['15cf9c02-1fbe-4d92-b23e-de3eebbabb4c', '5b074948-8652-4fcc-9f29-43e01da61580', '4ad1c112-658a-497d-9757-47c5947cd3f9', 'e999ae1b-6e62-4d86-90fe-4157ec12a53f'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5127ee6f-e1a9-41f8-aa40-db357e342cf6 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5127ee6f-e1a9-41f8-aa40-db357e342cf6 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5127ee6f-e1a9-41f8-aa40-db357e342cf6 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5127ee6f-e1a9-41f8-aa40-db357e342cf6 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5127ee6f-e1a9-41f8-aa40-db357e342cf6 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5127ee6f-e1a9-41f8-aa40-db357e342cf6 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:34 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:34 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:34 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7bf5f739-dfc3-416f-ab1a-07fc90f23e5b tempest-CinderUnicodeTest-1861901023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.3643867d-b01a-4942-a65b-8796ed2cc2fa" returned: 0 in 0.374s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7bf5f739-dfc3-416f-ab1a-07fc90f23e5b tempest-CinderUnicodeTest-1861901023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.3643867d-b01a-4942-a65b-8796ed2cc2fa {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:34 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.3643867d-b01a-4942-a65b-8796ed2cc2fa Sep 25 17:24:34 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:34 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5127ee6f-e1a9-41f8-aa40-db357e342cf6 tempest-CreateVolumesFromSnapshotTest-1396798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.264s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-5127ee6f-e1a9-41f8-aa40-db357e342cf6 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:34 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-5127ee6f-e1a9-41f8-aa40-db357e342cf6 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Deleted volume successfully. Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-5127ee6f-e1a9-41f8-aa40-db357e342cf6 tempest-CreateVolumesFromSnapshotTest-1396798611 None] Lock "cinder-29632c25-89e3-4edd-92fb-e25fde51bb2e-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:34 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7bf5f739-dfc3-416f-ab1a-07fc90f23e5b tempest-CinderUnicodeTest-1861901023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef.3643867d-b01a-4942-a65b-8796ed2cc2fa" returned: 0 in 0.293s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7bf5f739-dfc3-416f-ab1a-07fc90f23e5b tempest-CinderUnicodeTest-1861901023 None] Lock "cinder-quobyte-3643867d-b01a-4942-a65b-8796ed2cc2fa" released by "_delete_snapshot" :: held 1.616s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7bf5f739-dfc3-416f-ab1a-07fc90f23e5b tempest-CinderUnicodeTest-1861901023 None] Lock "cinder-quobyte-fd327b3f-0794-4e2a-9e63-2455556932ef" released by "delete_snapshot" :: held 1.641s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-7bf5f739-dfc3-416f-ab1a-07fc90f23e5b tempest-CinderUnicodeTest-1861901023 None] Created reservations ['a81277d8-6aea-4b7e-a875-b90ae03b6acd', 'fdced651-e2af-458b-9db5-31f246ea55bc', '5dc67836-8a13-4135-91ea-42bff545947d', '5167d491-3ca7-4f92-9d0c-c6c99fefb21e'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:34 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-7bf5f739-dfc3-416f-ab1a-07fc90f23e5b tempest-CinderUnicodeTest-1861901023 None] Delete snapshot completed successfully. Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7bf5f739-dfc3-416f-ab1a-07fc90f23e5b tempest-CinderUnicodeTest-1861901023 None] Lock "cinder-3643867d-b01a-4942-a65b-8796ed2cc2fa-delete_snapshot" released by "delete_snapshot" :: held 1.800s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c6db306a-1d80-4d35-9848-5fdc1e6cc3f9 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-2bf1437f-4b53-4756-b385-32dc04a43179-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c6db306a-1d80-4d35-9848-5fdc1e6cc3f9 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-2bf1437f-4b53-4756-b385-32dc04a43179-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c6db306a-1d80-4d35-9848-5fdc1e6cc3f9 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-46689a85-53ca-4670-aca8-06a6bca42f83" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c6db306a-1d80-4d35-9848-5fdc1e6cc3f9 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-46689a85-53ca-4670-aca8-06a6bca42f83" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c6db306a-1d80-4d35-9848-5fdc1e6cc3f9 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-2bf1437f-4b53-4756-b385-32dc04a43179" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c6db306a-1d80-4d35-9848-5fdc1e6cc3f9 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-2bf1437f-4b53-4756-b385-32dc04a43179" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-c6db306a-1d80-4d35-9848-5fdc1e6cc3f9 tempest-ProjectMemberTests-1497756053 None] Deleting offline snapshot 2bf1437f-4b53-4756-b385-32dc04a43179 of volume 46689a85-53ca-4670-aca8-06a6bca42f83 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-c6db306a-1d80-4d35-9848-5fdc1e6cc3f9 tempest-ProjectMemberTests-1497756053 None] snapshot_file for this snap is: volume-46689a85-53ca-4670-aca8-06a6bca42f83.2bf1437f-4b53-4756-b385-32dc04a43179 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3896f2-f2fa-45e8-899f-d1798de905e7]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c6db306a-1d80-4d35-9848-5fdc1e6cc3f9 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.2bf1437f-4b53-4756-b385-32dc04a43179 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:34 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.2bf1437f-4b53-4756-b385-32dc04a43179 Sep 25 17:24:34 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-760ac234-513b-446c-8758-ac4b8d2656d1 tempest-CinderUnicodeTest-1861901023 None] Acquiring lock "cinder-fd327b3f-0794-4e2a-9e63-2455556932ef-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-760ac234-513b-446c-8758-ac4b8d2656d1 tempest-CinderUnicodeTest-1861901023 None] Lock "cinder-fd327b3f-0794-4e2a-9e63-2455556932ef-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-760ac234-513b-446c-8758-ac4b8d2656d1 tempest-CinderUnicodeTest-1861901023 None] Acquiring lock "cinder-quobyte-fd327b3f-0794-4e2a-9e63-2455556932ef" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-760ac234-513b-446c-8758-ac4b8d2656d1 tempest-CinderUnicodeTest-1861901023 None] Lock "cinder-quobyte-fd327b3f-0794-4e2a-9e63-2455556932ef" acquired by "delete_volume" :: waited 0.040s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:35 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd46e7fe-ea92-4a72-9130-145cfa8bb794]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-760ac234-513b-446c-8758-ac4b8d2656d1 tempest-CinderUnicodeTest-1861901023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:35 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c6db306a-1d80-4d35-9848-5fdc1e6cc3f9 tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.2bf1437f-4b53-4756-b385-32dc04a43179" returned: 0 in 0.452s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:35 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-c6db306a-1d80-4d35-9848-5fdc1e6cc3f9 tempest-ProjectMemberTests-1497756053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46689a85-53ca-4670-aca8-06a6bca42f83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:24:35 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92b7d0a-9ce1-4d43-a1bf-eee2d09b3687]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c6db306a-1d80-4d35-9848-5fdc1e6cc3f9 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:35 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef Sep 25 17:24:35 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:35 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83 Sep 25 17:24:35 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:35 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-760ac234-513b-446c-8758-ac4b8d2656d1 tempest-CinderUnicodeTest-1861901023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef" returned: 0 in 0.426s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-760ac234-513b-446c-8758-ac4b8d2656d1 tempest-CinderUnicodeTest-1861901023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:35 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef Sep 25 17:24:35 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:35 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c6db306a-1d80-4d35-9848-5fdc1e6cc3f9 tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83" returned: 0 in 0.441s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c6db306a-1d80-4d35-9848-5fdc1e6cc3f9 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.2bf1437f-4b53-4756-b385-32dc04a43179 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:35 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.2bf1437f-4b53-4756-b385-32dc04a43179 Sep 25 17:24:35 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:35 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-760ac234-513b-446c-8758-ac4b8d2656d1 tempest-CinderUnicodeTest-1861901023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-fd327b3f-0794-4e2a-9e63-2455556932ef" returned: 0 in 0.315s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-760ac234-513b-446c-8758-ac4b8d2656d1 tempest-CinderUnicodeTest-1861901023 None] Lock "cinder-quobyte-fd327b3f-0794-4e2a-9e63-2455556932ef" released by "delete_volume" :: held 0.834s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:35 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-760ac234-513b-446c-8758-ac4b8d2656d1 tempest-CinderUnicodeTest-1861901023 None] Created reservations ['68a25a00-2494-4f9b-8095-cf9c8dd8cd87', 'cc74681a-6107-4d1c-8c4d-b46736f28df0', '70d82ad0-6d14-4783-8573-602f99266af4', '02d194df-815e-49a0-a2d9-fed5e662d32e'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-760ac234-513b-446c-8758-ac4b8d2656d1 tempest-CinderUnicodeTest-1861901023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-760ac234-513b-446c-8758-ac4b8d2656d1 tempest-CinderUnicodeTest-1861901023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:35 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-760ac234-513b-446c-8758-ac4b8d2656d1 tempest-CinderUnicodeTest-1861901023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:35 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-760ac234-513b-446c-8758-ac4b8d2656d1 tempest-CinderUnicodeTest-1861901023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-760ac234-513b-446c-8758-ac4b8d2656d1 tempest-CinderUnicodeTest-1861901023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-760ac234-513b-446c-8758-ac4b8d2656d1 tempest-CinderUnicodeTest-1861901023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:35 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:35 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c6db306a-1d80-4d35-9848-5fdc1e6cc3f9 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.2bf1437f-4b53-4756-b385-32dc04a43179" returned: 0 in 0.418s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:35 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c6db306a-1d80-4d35-9848-5fdc1e6cc3f9 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.2bf1437f-4b53-4756-b385-32dc04a43179 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:36 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.2bf1437f-4b53-4756-b385-32dc04a43179 Sep 25 17:24:36 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-88776161-8c90-4bab-a081-bfdd852da44e tempest-CinderUnicodeTest-1861901023 None] Acquiring lock "cinder-03423c4e-5777-4d69-a1d7-bbc9fa1929f5-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-88776161-8c90-4bab-a081-bfdd852da44e tempest-CinderUnicodeTest-1861901023 None] Lock "cinder-03423c4e-5777-4d69-a1d7-bbc9fa1929f5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-88776161-8c90-4bab-a081-bfdd852da44e tempest-CinderUnicodeTest-1861901023 None] Acquiring lock "cinder-quobyte-03423c4e-5777-4d69-a1d7-bbc9fa1929f5" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-88776161-8c90-4bab-a081-bfdd852da44e tempest-CinderUnicodeTest-1861901023 None] Lock "cinder-quobyte-03423c4e-5777-4d69-a1d7-bbc9fa1929f5" acquired by "delete_volume" :: waited 0.028s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:36 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f98d729-2104-41a2-9e2f-f3b3660a59cf]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-88776161-8c90-4bab-a081-bfdd852da44e tempest-CinderUnicodeTest-1861901023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-03423c4e-5777-4d69-a1d7-bbc9fa1929f5 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:36 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-760ac234-513b-446c-8758-ac4b8d2656d1 tempest-CinderUnicodeTest-1861901023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.421s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:36 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-760ac234-513b-446c-8758-ac4b8d2656d1 tempest-CinderUnicodeTest-1861901023 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:36 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-760ac234-513b-446c-8758-ac4b8d2656d1 tempest-CinderUnicodeTest-1861901023 None] Deleted volume successfully. Sep 25 17:24:36 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-760ac234-513b-446c-8758-ac4b8d2656d1 tempest-CinderUnicodeTest-1861901023 None] Lock "cinder-fd327b3f-0794-4e2a-9e63-2455556932ef-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c6db306a-1d80-4d35-9848-5fdc1e6cc3f9 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83.2bf1437f-4b53-4756-b385-32dc04a43179" returned: 0 in 0.418s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:36 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-03423c4e-5777-4d69-a1d7-bbc9fa1929f5 Sep 25 17:24:36 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c6db306a-1d80-4d35-9848-5fdc1e6cc3f9 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-2bf1437f-4b53-4756-b385-32dc04a43179" released by "_delete_snapshot" :: held 1.890s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c6db306a-1d80-4d35-9848-5fdc1e6cc3f9 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-46689a85-53ca-4670-aca8-06a6bca42f83" released by "delete_snapshot" :: held 1.917s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:36 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-c6db306a-1d80-4d35-9848-5fdc1e6cc3f9 tempest-ProjectMemberTests-1497756053 None] Created reservations ['22c3d1ba-21d4-4f30-a1ff-3074aa3ae787', '267468f7-0902-406a-ae75-d0cc69818f1e', '9fea44bb-d45b-4b4d-aedd-fe0326cc7e74', '0b24f698-5424-41de-83d5-56dd1efdcb4b'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:36 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-c6db306a-1d80-4d35-9848-5fdc1e6cc3f9 tempest-ProjectMemberTests-1497756053 None] Delete snapshot completed successfully. Sep 25 17:24:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c6db306a-1d80-4d35-9848-5fdc1e6cc3f9 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-2bf1437f-4b53-4756-b385-32dc04a43179-delete_snapshot" released by "delete_snapshot" :: held 2.068s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:36 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-88776161-8c90-4bab-a081-bfdd852da44e tempest-CinderUnicodeTest-1861901023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-03423c4e-5777-4d69-a1d7-bbc9fa1929f5" returned: 0 in 0.432s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-88776161-8c90-4bab-a081-bfdd852da44e tempest-CinderUnicodeTest-1861901023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-03423c4e-5777-4d69-a1d7-bbc9fa1929f5 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:36 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-03423c4e-5777-4d69-a1d7-bbc9fa1929f5 Sep 25 17:24:36 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-09064725-2ef7-4dc6-853b-d12d86e4d9f8 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-46689a85-53ca-4670-aca8-06a6bca42f83-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-09064725-2ef7-4dc6-853b-d12d86e4d9f8 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-46689a85-53ca-4670-aca8-06a6bca42f83-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-09064725-2ef7-4dc6-853b-d12d86e4d9f8 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-46689a85-53ca-4670-aca8-06a6bca42f83" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-09064725-2ef7-4dc6-853b-d12d86e4d9f8 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-46689a85-53ca-4670-aca8-06a6bca42f83" acquired by "delete_volume" :: waited 0.027s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:36 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c0fc08-596a-4d8f-a737-385021a1ba7c]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-09064725-2ef7-4dc6-853b-d12d86e4d9f8 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:37 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83 Sep 25 17:24:37 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:37 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-88776161-8c90-4bab-a081-bfdd852da44e tempest-CinderUnicodeTest-1861901023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-03423c4e-5777-4d69-a1d7-bbc9fa1929f5" returned: 0 in 0.340s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-88776161-8c90-4bab-a081-bfdd852da44e tempest-CinderUnicodeTest-1861901023 None] Lock "cinder-quobyte-03423c4e-5777-4d69-a1d7-bbc9fa1929f5" released by "delete_volume" :: held 0.827s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-88776161-8c90-4bab-a081-bfdd852da44e tempest-CinderUnicodeTest-1861901023 None] Created reservations ['b6e1cceb-0db7-4885-8173-8784a2474a99', '1795a915-86ca-4a05-ad08-5f7945e0b421', 'ea5cb7a2-ebd8-4466-961b-14c72d563b90', '32cd0e3f-f274-4aa2-becb-67a873d21931'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-88776161-8c90-4bab-a081-bfdd852da44e tempest-CinderUnicodeTest-1861901023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-88776161-8c90-4bab-a081-bfdd852da44e tempest-CinderUnicodeTest-1861901023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-88776161-8c90-4bab-a081-bfdd852da44e tempest-CinderUnicodeTest-1861901023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-88776161-8c90-4bab-a081-bfdd852da44e tempest-CinderUnicodeTest-1861901023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-88776161-8c90-4bab-a081-bfdd852da44e tempest-CinderUnicodeTest-1861901023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-88776161-8c90-4bab-a081-bfdd852da44e tempest-CinderUnicodeTest-1861901023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:37 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:37 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:37 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-09064725-2ef7-4dc6-853b-d12d86e4d9f8 tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83" returned: 0 in 0.440s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-09064725-2ef7-4dc6-853b-d12d86e4d9f8 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:37 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83 Sep 25 17:24:37 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:37 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-88776161-8c90-4bab-a081-bfdd852da44e tempest-CinderUnicodeTest-1861901023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.325s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-88776161-8c90-4bab-a081-bfdd852da44e tempest-CinderUnicodeTest-1861901023 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:37 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-88776161-8c90-4bab-a081-bfdd852da44e tempest-CinderUnicodeTest-1861901023 None] Deleted volume successfully. Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-88776161-8c90-4bab-a081-bfdd852da44e tempest-CinderUnicodeTest-1861901023 None] Lock "cinder-03423c4e-5777-4d69-a1d7-bbc9fa1929f5-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Flow 'volume_create_manager' (2e9c67a9-f480-4f4f-b90d-33c997f93144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a03f82e3-beb3-4a0e-b9b2-b13b0226760d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:37 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-09064725-2ef7-4dc6-853b-d12d86e4d9f8 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-46689a85-53ca-4670-aca8-06a6bca42f83" returned: 0 in 0.385s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a03f82e3-beb3-4a0e-b9b2-b13b0226760d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1741213316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88d37208-bc95-40a9-bff7-ce32fe18ee82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a81c8dcc5f4cec99ec5f4dfc22acf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:38Z,use_quota=True,user_id='f442e23246ae42bd96a0ad13271f3761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f90ba99-1c68-4de8-a0be-26e4e43185da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f90ba99-1c68-4de8-a0be-26e4e43185da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60efd6d-8ebf-4e56-8719-af8eb662ea32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60efd6d-8ebf-4e56-8719-af8eb662ea32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88d37208-bc95-40a9-bff7-ce32fe18ee82', 'volume_name': 'volume-88d37208-bc95-40a9-bff7-ce32fe18ee82', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1283af2d-1e82-4c6d-b7c8-e9db172079c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1283af2d-1e82-4c6d-b7c8-e9db172079c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0a5b4d-435a-44cc-ad09-c8829bc673bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:37 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Volume 88d37208-bc95-40a9-bff7-ce32fe18ee82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88d37208-bc95-40a9-bff7-ce32fe18ee82', 'volume_size': 1} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1741213316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88d37208-bc95-40a9-bff7-ce32fe18ee82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a81c8dcc5f4cec99ec5f4dfc22acf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:38Z,use_quota=True,user_id='f442e23246ae42bd96a0ad13271f3761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Creating volume 88d37208-bc95-40a9-bff7-ce32fe18ee82 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:37 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-88d37208-bc95-40a9-bff7-ce32fe18ee82 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-09064725-2ef7-4dc6-853b-d12d86e4d9f8 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-46689a85-53ca-4670-aca8-06a6bca42f83" released by "delete_volume" :: held 0.971s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:37 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-88d37208-bc95-40a9-bff7-ce32fe18ee82 1073741824 Sep 25 17:24:37 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:37 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-09064725-2ef7-4dc6-853b-d12d86e4d9f8 tempest-ProjectMemberTests-1497756053 None] Created reservations ['fb9ad463-80e2-4cdd-a2d1-4f9a6e7d1782', '0b7f5f79-6a4c-420a-ae2a-5a422b209172', '8b225f76-4ea7-48be-a5cd-a4efabdd4215', 'bb514293-240b-4194-b2df-a63a2b6c23da'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-09064725-2ef7-4dc6-853b-d12d86e4d9f8 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-09064725-2ef7-4dc6-853b-d12d86e4d9f8 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-09064725-2ef7-4dc6-853b-d12d86e4d9f8 tempest-ProjectMemberTests-1497756053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-09064725-2ef7-4dc6-853b-d12d86e4d9f8 tempest-ProjectMemberTests-1497756053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-09064725-2ef7-4dc6-853b-d12d86e4d9f8 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-09064725-2ef7-4dc6-853b-d12d86e4d9f8 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:38 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:38 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:38 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-09064725-2ef7-4dc6-853b-d12d86e4d9f8 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.274s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:38 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-09064725-2ef7-4dc6-853b-d12d86e4d9f8 tempest-ProjectMemberTests-1497756053 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:38 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-09064725-2ef7-4dc6-853b-d12d86e4d9f8 tempest-ProjectMemberTests-1497756053 None] Deleted volume successfully. Sep 25 17:24:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-09064725-2ef7-4dc6-853b-d12d86e4d9f8 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-46689a85-53ca-4670-aca8-06a6bca42f83-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:38 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-88d37208-bc95-40a9-bff7-ce32fe18ee82 1073741824" returned: 0 in 0.549s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-88d37208-bc95-40a9-bff7-ce32fe18ee82 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:38 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-88d37208-bc95-40a9-bff7-ce32fe18ee82 Sep 25 17:24:38 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:38 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-88d37208-bc95-40a9-bff7-ce32fe18ee82" returned: 0 in 0.263s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:38 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:38 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0a5b4d-435a-44cc-ad09-c8829bc673bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88d37208-bc95-40a9-bff7-ce32fe18ee82', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:38 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee493c4-7b19-4935-889b-1d28d7b2ec26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:38 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Volume volume-88d37208-bc95-40a9-bff7-ce32fe18ee82 (88d37208-bc95-40a9-bff7-ce32fe18ee82): created successfully Sep 25 17:24:38 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee493c4-7b19-4935-889b-1d28d7b2ec26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:38 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Flow 'volume_create_manager' (2e9c67a9-f480-4f4f-b90d-33c997f93144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:38 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-084a1e83-dc1b-40a3-b5c5-fde764d0c4c9 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Created volume successfully. Sep 25 17:24:39 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Flow 'volume_create_manager' (9ac586cb-fdbb-4f98-b786-31bc80628bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c11325c-93f4-4760-93f6-e24e3538bd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c11325c-93f4-4760-93f6-e24e3538bd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-472076383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4589f83-34d7-4241-b055-fe737ca2687c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31fdfb42d1d48219cd53e16d4a0131f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:39Z,use_quota=True,user_id='645f5007ad61465e9de1ac84410dacf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef2774c-eb2d-47ed-b5f0-a8f10d971e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef2774c-eb2d-47ed-b5f0-a8f10d971e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c34f7ff-4d69-4ef9-aa96-83ef2d463588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c34f7ff-4d69-4ef9-aa96-83ef2d463588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4589f83-34d7-4241-b055-fe737ca2687c', 'volume_name': 'volume-e4589f83-34d7-4241-b055-fe737ca2687c', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80805c0c-7604-47bb-ad69-5098d7507c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80805c0c-7604-47bb-ad69-5098d7507c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:39 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34235632-a916-46aa-841a-32ff5ea12b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:39 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Volume e4589f83-34d7-4241-b055-fe737ca2687c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4589f83-34d7-4241-b055-fe737ca2687c', 'volume_size': 1} Sep 25 17:24:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-472076383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4589f83-34d7-4241-b055-fe737ca2687c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31fdfb42d1d48219cd53e16d4a0131f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:39Z,use_quota=True,user_id='645f5007ad61465e9de1ac84410dacf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Creating volume e4589f83-34d7-4241-b055-fe737ca2687c {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:39 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:39 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c 1073741824 Sep 25 17:24:39 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:40 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c 1073741824" returned: 0 in 0.585s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:40 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c Sep 25 17:24:40 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Flow 'volume_create_manager' (ea683816-6b95-4360-9184-bf68bccd3811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (735c9227-477f-4156-8c00-300cd79d0dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (735c9227-477f-4156-8c00-300cd79d0dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-43011279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5312c137-15c1-4716-854e-98ceed75757c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a81c8dcc5f4cec99ec5f4dfc22acf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:40Z,use_quota=True,user_id='f442e23246ae42bd96a0ad13271f3761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6976a04-c807-4885-ae02-ce12f5bf4564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6976a04-c807-4885-ae02-ce12f5bf4564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c570fbea-f0ff-4c44-9340-ee9a4b822988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c570fbea-f0ff-4c44-9340-ee9a4b822988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5312c137-15c1-4716-854e-98ceed75757c', 'volume_name': 'volume-5312c137-15c1-4716-854e-98ceed75757c', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485ecd28-e8af-4025-8086-6cca5683e33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485ecd28-e8af-4025-8086-6cca5683e33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3efbe61c-a132-496d-bdd1-126652c19dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:40 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Volume 5312c137-15c1-4716-854e-98ceed75757c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5312c137-15c1-4716-854e-98ceed75757c', 'volume_size': 1} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:40 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c" returned: 0 in 0.389s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.139s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-43011279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5312c137-15c1-4716-854e-98ceed75757c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a81c8dcc5f4cec99ec5f4dfc22acf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:40Z,use_quota=True,user_id='f442e23246ae42bd96a0ad13271f3761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Creating volume 5312c137-15c1-4716-854e-98ceed75757c {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:40 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5312c137-15c1-4716-854e-98ceed75757c 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:40 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5312c137-15c1-4716-854e-98ceed75757c 1073741824 Sep 25 17:24:40 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34235632-a916-46aa-841a-32ff5ea12b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4589f83-34d7-4241-b055-fe737ca2687c', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f6e8cf-529e-497e-8ea0-1ce4447a4d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:40 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Volume volume-e4589f83-34d7-4241-b055-fe737ca2687c (e4589f83-34d7-4241-b055-fe737ca2687c): created successfully Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f6e8cf-529e-497e-8ea0-1ce4447a4d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Flow 'volume_create_manager' (9ac586cb-fdbb-4f98-b786-31bc80628bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Flow 'volume_create_manager' (13199390-0051-40f0-83f0-7469939e2031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a374de0-d8e3-48db-8cc5-07edb28ae4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:40 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-194c7dc3-7deb-4b88-ab10-38357f592417 tempest-ProjectMemberTests-1497756053 None] Created volume successfully. Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a374de0-d8e3-48db-8cc5-07edb28ae4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1662691333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a9a1b6-31cc-4ed3-992d-638085e24146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a81c8dcc5f4cec99ec5f4dfc22acf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:41Z,use_quota=True,user_id='f442e23246ae42bd96a0ad13271f3761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f66a118-456e-4844-9ffe-9b8fef8be7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f66a118-456e-4844-9ffe-9b8fef8be7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbfd707-9ebd-44aa-94a3-92f930ce2294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbfd707-9ebd-44aa-94a3-92f930ce2294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a9a1b6-31cc-4ed3-992d-638085e24146', 'volume_name': 'volume-19a9a1b6-31cc-4ed3-992d-638085e24146', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dacdb247-08c5-4471-9406-416139efd6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dacdb247-08c5-4471-9406-416139efd6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddce27d0-148e-4f78-877f-c5f24facceb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:40 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Volume 19a9a1b6-31cc-4ed3-992d-638085e24146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a9a1b6-31cc-4ed3-992d-638085e24146', 'volume_size': 1} Sep 25 17:24:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Flow 'volume_create_manager' (ca73df0f-ddd9-4aa5-a3c5-b7de4c0c8bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf44eb89-f223-4da5-ab92-2035fc02fb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf44eb89-f223-4da5-ab92-2035fc02fb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-82218200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bdef8e9-7536-488e-a364-18462dc87301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a81c8dcc5f4cec99ec5f4dfc22acf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:41Z,use_quota=True,user_id='f442e23246ae42bd96a0ad13271f3761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e720e4-5942-4496-aea3-7b7665c11b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e720e4-5942-4496-aea3-7b7665c11b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d636002-4593-4790-a7a3-5f4a0839b6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d636002-4593-4790-a7a3-5f4a0839b6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bdef8e9-7536-488e-a364-18462dc87301', 'volume_name': 'volume-5bdef8e9-7536-488e-a364-18462dc87301', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca1d341-a90a-4f1c-959e-006ba9db8bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca1d341-a90a-4f1c-959e-006ba9db8bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:41 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d385c3-dfec-4073-b92c-cf1e86ff0454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:41 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Volume 5bdef8e9-7536-488e-a364-18462dc87301: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bdef8e9-7536-488e-a364-18462dc87301', 'volume_size': 1} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5312c137-15c1-4716-854e-98ceed75757c 1073741824" returned: 0 in 0.685s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5312c137-15c1-4716-854e-98ceed75757c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:41 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5312c137-15c1-4716-854e-98ceed75757c Sep 25 17:24:41 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:41 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5312c137-15c1-4716-854e-98ceed75757c" returned: 0 in 0.310s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.800s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1662691333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a9a1b6-31cc-4ed3-992d-638085e24146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a81c8dcc5f4cec99ec5f4dfc22acf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:41Z,use_quota=True,user_id='f442e23246ae42bd96a0ad13271f3761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Creating volume 19a9a1b6-31cc-4ed3-992d-638085e24146 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:41 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-19a9a1b6-31cc-4ed3-992d-638085e24146 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:41 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-19a9a1b6-31cc-4ed3-992d-638085e24146 1073741824 Sep 25 17:24:41 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3efbe61c-a132-496d-bdd1-126652c19dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5312c137-15c1-4716-854e-98ceed75757c', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e2f901-e86c-4569-bac8-30c490a847f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Flow 'volume_create_manager' (a235b406-d719-42bc-b8a6-8a130823c12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c261fc-40bc-48df-a65d-5a331785b626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:41 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Volume volume-5312c137-15c1-4716-854e-98ceed75757c (5312c137-15c1-4716-854e-98ceed75757c): created successfully Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e2f901-e86c-4569-bac8-30c490a847f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Flow 'volume_create_manager' (ea683816-6b95-4360-9184-bf68bccd3811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c261fc-40bc-48df-a65d-5a331785b626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2072562536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30927b36-365f-49ec-b93e-e83c04a4d246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a81c8dcc5f4cec99ec5f4dfc22acf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:42Z,use_quota=True,user_id='f442e23246ae42bd96a0ad13271f3761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa94555-e995-4151-8444-e3abe47267bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa94555-e995-4151-8444-e3abe47267bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d56d6b2-b2b2-4c3d-8548-711752486550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d56d6b2-b2b2-4c3d-8548-711752486550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30927b36-365f-49ec-b93e-e83c04a4d246', 'volume_name': 'volume-30927b36-365f-49ec-b93e-e83c04a4d246', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52a8699-19b4-4b01-84f1-d854e44d1a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52a8699-19b4-4b01-84f1-d854e44d1a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e64b4a-e8a6-409a-a1ee-2d90922d7135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:42 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Volume 30927b36-365f-49ec-b93e-e83c04a4d246: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30927b36-365f-49ec-b93e-e83c04a4d246', 'volume_size': 1} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:42 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-78ab2cf4-98f7-4ac6-80d7-76b5c7fa8e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Created volume successfully. Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Flow 'volume_create_manager' (2ef60591-c74f-4b10-804c-d26796626388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ef665e-ad8e-4f30-9e3c-3a4825daaccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ef665e-ad8e-4f30-9e3c-3a4825daaccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1128635163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b56a3e51-ce96-4d97-869c-9786a73d5335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784ceac0fab64f9f842e927c40dac06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:42Z,use_quota=True,user_id='d52e638f870c40eeafb960bab0a3c015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d4a28f-744a-4511-b5cc-d81a748ba79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d4a28f-744a-4511-b5cc-d81a748ba79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb219d8-eb95-45ed-b1b3-d3dcbf1418d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb219d8-eb95-45ed-b1b3-d3dcbf1418d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b56a3e51-ce96-4d97-869c-9786a73d5335', 'volume_name': 'volume-b56a3e51-ce96-4d97-869c-9786a73d5335', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cea78cd-64d5-4b96-bbc6-57549b0ede13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cea78cd-64d5-4b96-bbc6-57549b0ede13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7675782f-93e6-44a3-8bdc-f665410f5c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:42 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Volume b56a3e51-ce96-4d97-869c-9786a73d5335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b56a3e51-ce96-4d97-869c-9786a73d5335', 'volume_size': 1} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7a0f9201-f35c-4e74-aa1c-d3e40f42bc51 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Flow 'volume_create_manager' (c4ef8f80-76fa-4f4f-82ae-3bcfce6d7ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d60a2f6-ad06-4dbd-807a-ca531dabe6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:42 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d60a2f6-ad06-4dbd-807a-ca531dabe6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1901663988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca10acfc-5ba2-4a67-bd84-c42c79474bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a81c8dcc5f4cec99ec5f4dfc22acf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:42Z,use_quota=True,user_id='f442e23246ae42bd96a0ad13271f3761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6301746a-8e26-4c44-b4e9-1bd7f2c40ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6301746a-8e26-4c44-b4e9-1bd7f2c40ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26d97c7-5267-4f4b-94b8-c6423120394c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26d97c7-5267-4f4b-94b8-c6423120394c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca10acfc-5ba2-4a67-bd84-c42c79474bc3', 'volume_name': 'volume-ca10acfc-5ba2-4a67-bd84-c42c79474bc3', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62572417-fe9c-466d-8959-58737bfb30ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62572417-fe9c-466d-8959-58737bfb30ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb8a6633-5b17-4019-a7a4-b25b777604ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:42 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Volume ca10acfc-5ba2-4a67-bd84-c42c79474bc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca10acfc-5ba2-4a67-bd84-c42c79474bc3', 'volume_size': 1} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-19a9a1b6-31cc-4ed3-992d-638085e24146 1073741824" returned: 0 in 0.796s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-19a9a1b6-31cc-4ed3-992d-638085e24146 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:42 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-19a9a1b6-31cc-4ed3-992d-638085e24146 Sep 25 17:24:42 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:42 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-19a9a1b6-31cc-4ed3-992d-638085e24146" returned: 0 in 0.238s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.457s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-82218200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bdef8e9-7536-488e-a364-18462dc87301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a81c8dcc5f4cec99ec5f4dfc22acf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:41Z,use_quota=True,user_id='f442e23246ae42bd96a0ad13271f3761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Creating volume 5bdef8e9-7536-488e-a364-18462dc87301 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:42 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bdef8e9-7536-488e-a364-18462dc87301 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddce27d0-148e-4f78-877f-c5f24facceb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a9a1b6-31cc-4ed3-992d-638085e24146', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab69a75-75bf-45c6-95fd-40d6ec5be393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:42 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bdef8e9-7536-488e-a364-18462dc87301 1073741824 Sep 25 17:24:42 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:42 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Volume volume-19a9a1b6-31cc-4ed3-992d-638085e24146 (19a9a1b6-31cc-4ed3-992d-638085e24146): created successfully Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab69a75-75bf-45c6-95fd-40d6ec5be393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:42 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Flow 'volume_create_manager' (13199390-0051-40f0-83f0-7469939e2031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:42 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-46e57b11-2d3d-40b4-9b78-b34f41033960 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Created volume successfully. Sep 25 17:24:43 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bdef8e9-7536-488e-a364-18462dc87301 1073741824" returned: 0 in 0.425s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bdef8e9-7536-488e-a364-18462dc87301 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:43 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bdef8e9-7536-488e-a364-18462dc87301 Sep 25 17:24:43 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:43 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bdef8e9-7536-488e-a364-18462dc87301" returned: 0 in 0.266s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.464s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2072562536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30927b36-365f-49ec-b93e-e83c04a4d246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a81c8dcc5f4cec99ec5f4dfc22acf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:42Z,use_quota=True,user_id='f442e23246ae42bd96a0ad13271f3761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Creating volume 30927b36-365f-49ec-b93e-e83c04a4d246 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:43 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30927b36-365f-49ec-b93e-e83c04a4d246 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:43 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d385c3-dfec-4073-b92c-cf1e86ff0454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bdef8e9-7536-488e-a364-18462dc87301', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:43 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30927b36-365f-49ec-b93e-e83c04a4d246 1073741824 Sep 25 17:24:43 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:43 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d2cf0d8-f501-411c-ac51-409f91040c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:43 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Volume volume-5bdef8e9-7536-488e-a364-18462dc87301 (5bdef8e9-7536-488e-a364-18462dc87301): created successfully Sep 25 17:24:43 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d2cf0d8-f501-411c-ac51-409f91040c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:43 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Flow 'volume_create_manager' (ca73df0f-ddd9-4aa5-a3c5-b7de4c0c8bf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:43 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:UPDATE=296,cinder:SELECT=217,cinder:INSERT=82,cinder:DELETE=26 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:24:43 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-37c54a69-f7b0-409e-b1ef-a674bf6fbabe tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Created volume successfully. Sep 25 17:24:44 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30927b36-365f-49ec-b93e-e83c04a4d246 1073741824" returned: 0 in 0.436s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:44 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=222,cinder:UPDATE=295,cinder:DELETE=28,cinder:INSERT=68 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:24:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30927b36-365f-49ec-b93e-e83c04a4d246 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:44 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30927b36-365f-49ec-b93e-e83c04a4d246 Sep 25 17:24:44 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:44 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30927b36-365f-49ec-b93e-e83c04a4d246" returned: 0 in 0.267s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.033s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1128635163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b56a3e51-ce96-4d97-869c-9786a73d5335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784ceac0fab64f9f842e927c40dac06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:42Z,use_quota=True,user_id='d52e638f870c40eeafb960bab0a3c015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Creating volume b56a3e51-ce96-4d97-869c-9786a73d5335 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:44 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e64b4a-e8a6-409a-a1ee-2d90922d7135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30927b36-365f-49ec-b93e-e83c04a4d246', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:44 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335 1073741824 Sep 25 17:24:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d4e3cf-fc35-4a4a-9727-8e3f63651717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:44 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:44 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Volume volume-30927b36-365f-49ec-b93e-e83c04a4d246 (30927b36-365f-49ec-b93e-e83c04a4d246): created successfully Sep 25 17:24:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d4e3cf-fc35-4a4a-9727-8e3f63651717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:44 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Flow 'volume_create_manager' (a235b406-d719-42bc-b8a6-8a130823c12c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:44 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-5cf733c7-8a25-4abc-9ff6-a7832aede02e tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Created volume successfully. Sep 25 17:24:44 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335 1073741824" returned: 0 in 0.465s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:44 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335 Sep 25 17:24:44 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:45 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335" returned: 0 in 0.256s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7a0f9201-f35c-4e74-aa1c-d3e40f42bc51 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.800s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7675782f-93e6-44a3-8bdc-f665410f5c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b56a3e51-ce96-4d97-869c-9786a73d5335', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53381a0-85cc-4839-b52e-9d5c9202c0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-7a0f9201-f35c-4e74-aa1c-d3e40f42bc51 tempest-ProjectMemberTests-1497756053 None] Creating offline snapshot 71725918-6de9-456e-b9d8-f512c0cd378d of volume e4589f83-34d7-4241-b055-fe737ca2687c {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:24:45 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Volume volume-b56a3e51-ce96-4d97-869c-9786a73d5335 (b56a3e51-ce96-4d97-869c-9786a73d5335): created successfully Sep 25 17:24:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53381a0-85cc-4839-b52e-9d5c9202c0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:45 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Flow 'volume_create_manager' (2ef60591-c74f-4b10-804c-d26796626388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:45 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[063141a2-53cf-4d69-b9b1-37296759f991]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7a0f9201-f35c-4e74-aa1c-d3e40f42bc51 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:45 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-311fc2c1-6b7d-4747-999b-2dc03d03428a tempest-ProjectReaderTests-2080899454 None] Created volume successfully. Sep 25 17:24:45 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c Sep 25 17:24:45 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:45 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7a0f9201-f35c-4e74-aa1c-d3e40f42bc51 tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c" returned: 0 in 0.398s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7a0f9201-f35c-4e74-aa1c-d3e40f42bc51 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.71725918-6de9-456e-b9d8-f512c0cd378d 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:45 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.71725918-6de9-456e-b9d8-f512c0cd378d 1G Sep 25 17:24:45 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-38224bea-c531-4d50-8929-c52858d9c5f8 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:46 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7a0f9201-f35c-4e74-aa1c-d3e40f42bc51 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.71725918-6de9-456e-b9d8-f512c0cd378d 1G" returned: 0 in 0.469s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7a0f9201-f35c-4e74-aa1c-d3e40f42bc51 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4589f83-34d7-4241-b055-fe737ca2687c -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.71725918-6de9-456e-b9d8-f512c0cd378d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:46 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4589f83-34d7-4241-b055-fe737ca2687c -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.71725918-6de9-456e-b9d8-f512c0cd378d Sep 25 17:24:46 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:46 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7a0f9201-f35c-4e74-aa1c-d3e40f42bc51 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4589f83-34d7-4241-b055-fe737ca2687c -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.71725918-6de9-456e-b9d8-f512c0cd378d" returned: 0 in 0.297s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:46 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-7a0f9201-f35c-4e74-aa1c-d3e40f42bc51 tempest-ProjectMemberTests-1497756053 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.71725918-6de9-456e-b9d8-f512c0cd378d is being set with open permissions: ugo+rw Sep 25 17:24:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7a0f9201-f35c-4e74-aa1c-d3e40f42bc51 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.71725918-6de9-456e-b9d8-f512c0cd378d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:46 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.71725918-6de9-456e-b9d8-f512c0cd378d Sep 25 17:24:46 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:46 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7a0f9201-f35c-4e74-aa1c-d3e40f42bc51 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.71725918-6de9-456e-b9d8-f512c0cd378d" returned: 0 in 0.271s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7a0f9201-f35c-4e74-aa1c-d3e40f42bc51 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:46 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.info Sep 25 17:24:46 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:46 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7a0f9201-f35c-4e74-aa1c-d3e40f42bc51 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.info" returned: 0 in 0.267s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:46 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-7a0f9201-f35c-4e74-aa1c-d3e40f42bc51 tempest-ProjectMemberTests-1497756053 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.info is being set with open permissions: ugo+rw Sep 25 17:24:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7a0f9201-f35c-4e74-aa1c-d3e40f42bc51 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:46 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.info Sep 25 17:24:46 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:47 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7a0f9201-f35c-4e74-aa1c-d3e40f42bc51 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.info" returned: 0 in 0.262s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-7a0f9201-f35c-4e74-aa1c-d3e40f42bc51 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.082s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.646s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1901663988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca10acfc-5ba2-4a67-bd84-c42c79474bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a81c8dcc5f4cec99ec5f4dfc22acf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:42Z,use_quota=True,user_id='f442e23246ae42bd96a0ad13271f3761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Creating volume ca10acfc-5ba2-4a67-bd84-c42c79474bc3 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:47 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ca10acfc-5ba2-4a67-bd84-c42c79474bc3 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:47 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ca10acfc-5ba2-4a67-bd84-c42c79474bc3 1073741824 Sep 25 17:24:47 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:47 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-7a0f9201-f35c-4e74-aa1c-d3e40f42bc51 tempest-ProjectMemberTests-1497756053 None] Create snapshot completed successfully Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-225723e1-b8cf-44fb-971d-cc6369603a66 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-71725918-6de9-456e-b9d8-f512c0cd378d-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-225723e1-b8cf-44fb-971d-cc6369603a66 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-71725918-6de9-456e-b9d8-f512c0cd378d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-225723e1-b8cf-44fb-971d-cc6369603a66 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-e4589f83-34d7-4241-b055-fe737ca2687c" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-225723e1-b8cf-44fb-971d-cc6369603a66 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-e4589f83-34d7-4241-b055-fe737ca2687c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-225723e1-b8cf-44fb-971d-cc6369603a66 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-71725918-6de9-456e-b9d8-f512c0cd378d" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-225723e1-b8cf-44fb-971d-cc6369603a66 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-71725918-6de9-456e-b9d8-f512c0cd378d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-225723e1-b8cf-44fb-971d-cc6369603a66 tempest-ProjectMemberTests-1497756053 None] Deleting offline snapshot 71725918-6de9-456e-b9d8-f512c0cd378d of volume e4589f83-34d7-4241-b055-fe737ca2687c {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-225723e1-b8cf-44fb-971d-cc6369603a66 tempest-ProjectMemberTests-1497756053 None] snapshot_file for this snap is: volume-e4589f83-34d7-4241-b055-fe737ca2687c.71725918-6de9-456e-b9d8-f512c0cd378d {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6012d0-5683-4728-b2d3-c28a73395684]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-225723e1-b8cf-44fb-971d-cc6369603a66 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.71725918-6de9-456e-b9d8-f512c0cd378d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:47 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ca10acfc-5ba2-4a67-bd84-c42c79474bc3 1073741824" returned: 0 in 0.493s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:47 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.71725918-6de9-456e-b9d8-f512c0cd378d Sep 25 17:24:47 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ca10acfc-5ba2-4a67-bd84-c42c79474bc3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:47 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ca10acfc-5ba2-4a67-bd84-c42c79474bc3 Sep 25 17:24:47 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:48 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-225723e1-b8cf-44fb-971d-cc6369603a66 tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.71725918-6de9-456e-b9d8-f512c0cd378d" returned: 0 in 0.401s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-225723e1-b8cf-44fb-971d-cc6369603a66 tempest-ProjectMemberTests-1497756053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4589f83-34d7-4241-b055-fe737ca2687c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:24:48 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32dd24d-00b7-4fa0-8aa2-c0491eafded7]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-225723e1-b8cf-44fb-971d-cc6369603a66 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:48 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ca10acfc-5ba2-4a67-bd84-c42c79474bc3" returned: 0 in 0.322s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-38224bea-c531-4d50-8929-c52858d9c5f8 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.392s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb8a6633-5b17-4019-a7a4-b25b777604ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca10acfc-5ba2-4a67-bd84-c42c79474bc3', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d18aff2-fd48-4481-9b8f-9cfa76aa80f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-38224bea-c531-4d50-8929-c52858d9c5f8 tempest-ProjectReaderTests-2080899454 None] Creating offline snapshot f154a5ba-8cce-4909-a2b5-ee6bba870234 of volume b56a3e51-ce96-4d97-869c-9786a73d5335 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:24:48 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Volume volume-ca10acfc-5ba2-4a67-bd84-c42c79474bc3 (ca10acfc-5ba2-4a67-bd84-c42c79474bc3): created successfully Sep 25 17:24:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d18aff2-fd48-4481-9b8f-9cfa76aa80f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:48 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Flow 'volume_create_manager' (c4ef8f80-76fa-4f4f-82ae-3bcfce6d7ee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:48 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c08246-19e2-425d-845f-ef7e964e165f]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-38224bea-c531-4d50-8929-c52858d9c5f8 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:48 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-906f1b9d-6c57-4e96-b30c-b201fedf6e68 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Created volume successfully. Sep 25 17:24:48 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c Sep 25 17:24:48 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:48 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335 Sep 25 17:24:48 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:48 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-225723e1-b8cf-44fb-971d-cc6369603a66 tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c" returned: 0 in 0.388s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-225723e1-b8cf-44fb-971d-cc6369603a66 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.71725918-6de9-456e-b9d8-f512c0cd378d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:48 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.71725918-6de9-456e-b9d8-f512c0cd378d Sep 25 17:24:48 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:48 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-38224bea-c531-4d50-8929-c52858d9c5f8 tempest-ProjectReaderTests-2080899454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335" returned: 0 in 0.405s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-38224bea-c531-4d50-8929-c52858d9c5f8 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.f154a5ba-8cce-4909-a2b5-ee6bba870234 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:48 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.f154a5ba-8cce-4909-a2b5-ee6bba870234 1G Sep 25 17:24:48 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:48 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-225723e1-b8cf-44fb-971d-cc6369603a66 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.71725918-6de9-456e-b9d8-f512c0cd378d" returned: 0 in 0.396s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-225723e1-b8cf-44fb-971d-cc6369603a66 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.71725918-6de9-456e-b9d8-f512c0cd378d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:48 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.71725918-6de9-456e-b9d8-f512c0cd378d Sep 25 17:24:48 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:49 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-38224bea-c531-4d50-8929-c52858d9c5f8 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.f154a5ba-8cce-4909-a2b5-ee6bba870234 1G" returned: 0 in 0.484s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-38224bea-c531-4d50-8929-c52858d9c5f8 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b56a3e51-ce96-4d97-869c-9786a73d5335 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.f154a5ba-8cce-4909-a2b5-ee6bba870234 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:49 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b56a3e51-ce96-4d97-869c-9786a73d5335 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.f154a5ba-8cce-4909-a2b5-ee6bba870234 Sep 25 17:24:49 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f9c0bf95-5b9b-4dd9-a103-042ba7a037a4 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "cinder-ca10acfc-5ba2-4a67-bd84-c42c79474bc3-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:49 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-225723e1-b8cf-44fb-971d-cc6369603a66 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c.71725918-6de9-456e-b9d8-f512c0cd378d" returned: 0 in 0.328s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f9c0bf95-5b9b-4dd9-a103-042ba7a037a4 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-ca10acfc-5ba2-4a67-bd84-c42c79474bc3-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-225723e1-b8cf-44fb-971d-cc6369603a66 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-71725918-6de9-456e-b9d8-f512c0cd378d" released by "_delete_snapshot" :: held 1.649s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-225723e1-b8cf-44fb-971d-cc6369603a66 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-e4589f83-34d7-4241-b055-fe737ca2687c" released by "delete_snapshot" :: held 1.680s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f9c0bf95-5b9b-4dd9-a103-042ba7a037a4 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "cinder-quobyte-ca10acfc-5ba2-4a67-bd84-c42c79474bc3" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f9c0bf95-5b9b-4dd9-a103-042ba7a037a4 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-quobyte-ca10acfc-5ba2-4a67-bd84-c42c79474bc3" acquired by "delete_volume" :: waited 0.026s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1c75fb-bf13-41b4-a33b-d57a3be305e7]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f9c0bf95-5b9b-4dd9-a103-042ba7a037a4 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ca10acfc-5ba2-4a67-bd84-c42c79474bc3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-225723e1-b8cf-44fb-971d-cc6369603a66 tempest-ProjectMemberTests-1497756053 None] Created reservations ['2f17d877-0f9f-4b82-817f-2d30ed5f283f', 'a99deec2-edf8-4752-9b85-cb4577908ade', '269c6a43-d5ca-4ff9-ba1b-4bed1f3f1df7', '114797c4-46f2-4883-87a4-c270cd350000'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:49 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-225723e1-b8cf-44fb-971d-cc6369603a66 tempest-ProjectMemberTests-1497756053 None] Delete snapshot completed successfully. Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-225723e1-b8cf-44fb-971d-cc6369603a66 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-71725918-6de9-456e-b9d8-f512c0cd378d-delete_snapshot" released by "delete_snapshot" :: held 1.944s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:49 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-38224bea-c531-4d50-8929-c52858d9c5f8 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b56a3e51-ce96-4d97-869c-9786a73d5335 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.f154a5ba-8cce-4909-a2b5-ee6bba870234" returned: 0 in 0.450s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:49 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-38224bea-c531-4d50-8929-c52858d9c5f8 tempest-ProjectReaderTests-2080899454 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.f154a5ba-8cce-4909-a2b5-ee6bba870234 is being set with open permissions: ugo+rw Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-38224bea-c531-4d50-8929-c52858d9c5f8 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.f154a5ba-8cce-4909-a2b5-ee6bba870234 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:49 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ca10acfc-5ba2-4a67-bd84-c42c79474bc3 Sep 25 17:24:49 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:49 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.f154a5ba-8cce-4909-a2b5-ee6bba870234 Sep 25 17:24:49 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a63e6645-d3c5-4749-865c-aa4966bd178f tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-e4589f83-34d7-4241-b055-fe737ca2687c-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a63e6645-d3c5-4749-865c-aa4966bd178f tempest-ProjectMemberTests-1497756053 None] Lock "cinder-e4589f83-34d7-4241-b055-fe737ca2687c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a63e6645-d3c5-4749-865c-aa4966bd178f tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-e4589f83-34d7-4241-b055-fe737ca2687c" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a63e6645-d3c5-4749-865c-aa4966bd178f tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-e4589f83-34d7-4241-b055-fe737ca2687c" acquired by "delete_volume" :: waited 0.017s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:49 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-38224bea-c531-4d50-8929-c52858d9c5f8 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.f154a5ba-8cce-4909-a2b5-ee6bba870234" returned: 0 in 0.360s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:49 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f9c0bf95-5b9b-4dd9-a103-042ba7a037a4 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ca10acfc-5ba2-4a67-bd84-c42c79474bc3" returned: 0 in 0.518s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f9c0bf95-5b9b-4dd9-a103-042ba7a037a4 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ca10acfc-5ba2-4a67-bd84-c42c79474bc3 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb10a1d-65c5-4636-aa67-5c4393329f58]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a63e6645-d3c5-4749-865c-aa4966bd178f tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:49 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ca10acfc-5ba2-4a67-bd84-c42c79474bc3 Sep 25 17:24:49 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:49 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-38224bea-c531-4d50-8929-c52858d9c5f8 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:49 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.info Sep 25 17:24:49 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:50 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c Sep 25 17:24:50 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:50 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f9c0bf95-5b9b-4dd9-a103-042ba7a037a4 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ca10acfc-5ba2-4a67-bd84-c42c79474bc3" returned: 0 in 0.280s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f9c0bf95-5b9b-4dd9-a103-042ba7a037a4 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-quobyte-ca10acfc-5ba2-4a67-bd84-c42c79474bc3" released by "delete_volume" :: held 0.852s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:50 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-38224bea-c531-4d50-8929-c52858d9c5f8 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.info" returned: 0 in 0.317s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:50 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-38224bea-c531-4d50-8929-c52858d9c5f8 tempest-ProjectReaderTests-2080899454 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.info is being set with open permissions: ugo+rw Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-38224bea-c531-4d50-8929-c52858d9c5f8 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:50 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.info Sep 25 17:24:50 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-f9c0bf95-5b9b-4dd9-a103-042ba7a037a4 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Created reservations ['3bf64f68-2fdc-45bb-a423-9922bd28c9c5', '10b1cd1e-1acc-49a5-b7ba-0db7078197f4', '864fd84a-f979-494c-be9b-1d0c1565ce98', '56e040fc-dfe2-4c31-8361-ef8e17bee305'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f9c0bf95-5b9b-4dd9-a103-042ba7a037a4 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f9c0bf95-5b9b-4dd9-a103-042ba7a037a4 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f9c0bf95-5b9b-4dd9-a103-042ba7a037a4 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f9c0bf95-5b9b-4dd9-a103-042ba7a037a4 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f9c0bf95-5b9b-4dd9-a103-042ba7a037a4 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f9c0bf95-5b9b-4dd9-a103-042ba7a037a4 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:50 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:50 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:50 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a63e6645-d3c5-4749-865c-aa4966bd178f tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c" returned: 0 in 0.530s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a63e6645-d3c5-4749-865c-aa4966bd178f tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f50221cf-ea84-46ca-b296-c0b1021dd7f7 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "cinder-30927b36-365f-49ec-b93e-e83c04a4d246-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:50 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f50221cf-ea84-46ca-b296-c0b1021dd7f7 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-30927b36-365f-49ec-b93e-e83c04a4d246-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:50 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:50 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f50221cf-ea84-46ca-b296-c0b1021dd7f7 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "cinder-quobyte-30927b36-365f-49ec-b93e-e83c04a4d246" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-38224bea-c531-4d50-8929-c52858d9c5f8 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.info" returned: 0 in 0.336s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-38224bea-c531-4d50-8929-c52858d9c5f8 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.502s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f50221cf-ea84-46ca-b296-c0b1021dd7f7 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-quobyte-30927b36-365f-49ec-b93e-e83c04a4d246" acquired by "delete_volume" :: waited 0.049s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:50 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-38224bea-c531-4d50-8929-c52858d9c5f8 tempest-ProjectReaderTests-2080899454 None] Create snapshot completed successfully Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[01697527-9238-4844-adda-686b91322a23]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f50221cf-ea84-46ca-b296-c0b1021dd7f7 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30927b36-365f-49ec-b93e-e83c04a4d246 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:50 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f9c0bf95-5b9b-4dd9-a103-042ba7a037a4 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.323s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-f9c0bf95-5b9b-4dd9-a103-042ba7a037a4 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:50 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-f9c0bf95-5b9b-4dd9-a103-042ba7a037a4 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Deleted volume successfully. Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f9c0bf95-5b9b-4dd9-a103-042ba7a037a4 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-ca10acfc-5ba2-4a67-bd84-c42c79474bc3-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:50 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30927b36-365f-49ec-b93e-e83c04a4d246 Sep 25 17:24:50 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:50 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a63e6645-d3c5-4749-865c-aa4966bd178f tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-e4589f83-34d7-4241-b055-fe737ca2687c" returned: 0 in 0.381s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a63e6645-d3c5-4749-865c-aa4966bd178f tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-e4589f83-34d7-4241-b055-fe737ca2687c" released by "delete_volume" :: held 1.023s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-a63e6645-d3c5-4749-865c-aa4966bd178f tempest-ProjectMemberTests-1497756053 None] Created reservations ['10e84bf6-9ad3-4558-861e-550207cafd91', 'a41d46a9-0ca2-41a0-b660-bfe697332d26', '2bf74d7c-c42e-4000-a88e-373ac4b1bf7b', '20ee9c9f-ad3e-4ac3-9b11-aa58acaf38cd'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a63e6645-d3c5-4749-865c-aa4966bd178f tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a63e6645-d3c5-4749-865c-aa4966bd178f tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a63e6645-d3c5-4749-865c-aa4966bd178f tempest-ProjectMemberTests-1497756053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a63e6645-d3c5-4749-865c-aa4966bd178f tempest-ProjectMemberTests-1497756053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a63e6645-d3c5-4749-865c-aa4966bd178f tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:50 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a63e6645-d3c5-4749-865c-aa4966bd178f tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:51 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:51 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:51 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f50221cf-ea84-46ca-b296-c0b1021dd7f7 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30927b36-365f-49ec-b93e-e83c04a4d246" returned: 0 in 0.446s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f50221cf-ea84-46ca-b296-c0b1021dd7f7 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30927b36-365f-49ec-b93e-e83c04a4d246 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:51 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30927b36-365f-49ec-b93e-e83c04a4d246 Sep 25 17:24:51 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-df25a4f0-5f92-4782-aa42-f68b8bfc07fe tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-f154a5ba-8cce-4909-a2b5-ee6bba870234-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-df25a4f0-5f92-4782-aa42-f68b8bfc07fe tempest-ProjectReaderTests-2080899454 None] Lock "cinder-f154a5ba-8cce-4909-a2b5-ee6bba870234-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:51 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-df25a4f0-5f92-4782-aa42-f68b8bfc07fe tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-quobyte-b56a3e51-ce96-4d97-869c-9786a73d5335" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a63e6645-d3c5-4749-865c-aa4966bd178f tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.336s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-a63e6645-d3c5-4749-865c-aa4966bd178f tempest-ProjectMemberTests-1497756053 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:51 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-a63e6645-d3c5-4749-865c-aa4966bd178f tempest-ProjectMemberTests-1497756053 None] Deleted volume successfully. Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-df25a4f0-5f92-4782-aa42-f68b8bfc07fe tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-b56a3e51-ce96-4d97-869c-9786a73d5335" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-df25a4f0-5f92-4782-aa42-f68b8bfc07fe tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-quobyte-f154a5ba-8cce-4909-a2b5-ee6bba870234" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-df25a4f0-5f92-4782-aa42-f68b8bfc07fe tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-f154a5ba-8cce-4909-a2b5-ee6bba870234" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-df25a4f0-5f92-4782-aa42-f68b8bfc07fe tempest-ProjectReaderTests-2080899454 None] Deleting offline snapshot f154a5ba-8cce-4909-a2b5-ee6bba870234 of volume b56a3e51-ce96-4d97-869c-9786a73d5335 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-df25a4f0-5f92-4782-aa42-f68b8bfc07fe tempest-ProjectReaderTests-2080899454 None] snapshot_file for this snap is: volume-b56a3e51-ce96-4d97-869c-9786a73d5335.f154a5ba-8cce-4909-a2b5-ee6bba870234 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a63e6645-d3c5-4749-865c-aa4966bd178f tempest-ProjectMemberTests-1497756053 None] Lock "cinder-e4589f83-34d7-4241-b055-fe737ca2687c-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa75e66-2c95-43cc-ba96-76b112a8cd6b]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-df25a4f0-5f92-4782-aa42-f68b8bfc07fe tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.f154a5ba-8cce-4909-a2b5-ee6bba870234 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:51 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f50221cf-ea84-46ca-b296-c0b1021dd7f7 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-30927b36-365f-49ec-b93e-e83c04a4d246" returned: 0 in 0.419s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f50221cf-ea84-46ca-b296-c0b1021dd7f7 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-quobyte-30927b36-365f-49ec-b93e-e83c04a4d246" released by "delete_volume" :: held 0.931s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:51 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.f154a5ba-8cce-4909-a2b5-ee6bba870234 Sep 25 17:24:51 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-f50221cf-ea84-46ca-b296-c0b1021dd7f7 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Created reservations ['e6752b7d-d0b8-475c-8321-9794c8d9beeb', '31ad4064-02e7-4251-8672-f5cbae7aa176', 'f974ce65-46e5-4bee-b3d1-336cad23abfa', 'fed5ba7a-9405-45d2-8c46-3d4e45473a15'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Flow 'volume_create_manager' (c2528cdf-cc35-4721-974d-34a4c31150ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe549c6-7614-4048-911e-ff53cb05f4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe549c6-7614-4048-911e-ff53cb05f4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1436629625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91381c04-1d26-4f28-9a64-dbc33605ae4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31fdfb42d1d48219cd53e16d4a0131f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:52Z,use_quota=True,user_id='645f5007ad61465e9de1ac84410dacf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f9e1d2-ea98-426d-bd3d-49b41b3c3182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f9e1d2-ea98-426d-bd3d-49b41b3c3182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc93237-0804-4250-bb0c-c051e6eab46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc93237-0804-4250-bb0c-c051e6eab46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91381c04-1d26-4f28-9a64-dbc33605ae4d', 'volume_name': 'volume-91381c04-1d26-4f28-9a64-dbc33605ae4d', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (821e226c-c42f-408e-837d-8193e7a31b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (821e226c-c42f-408e-837d-8193e7a31b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca92f118-960d-43c7-b164-315bc3d11545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:51 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Volume 91381c04-1d26-4f28-9a64-dbc33605ae4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91381c04-1d26-4f28-9a64-dbc33605ae4d', 'volume_size': 1} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1436629625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91381c04-1d26-4f28-9a64-dbc33605ae4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31fdfb42d1d48219cd53e16d4a0131f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:52Z,use_quota=True,user_id='645f5007ad61465e9de1ac84410dacf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Creating volume 91381c04-1d26-4f28-9a64-dbc33605ae4d {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:51 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f50221cf-ea84-46ca-b296-c0b1021dd7f7 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f50221cf-ea84-46ca-b296-c0b1021dd7f7 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f50221cf-ea84-46ca-b296-c0b1021dd7f7 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-f50221cf-ea84-46ca-b296-c0b1021dd7f7 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f50221cf-ea84-46ca-b296-c0b1021dd7f7 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f50221cf-ea84-46ca-b296-c0b1021dd7f7 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:51 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d 1073741824 Sep 25 17:24:51 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:51 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:51 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:51 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-df25a4f0-5f92-4782-aa42-f68b8bfc07fe tempest-ProjectReaderTests-2080899454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.f154a5ba-8cce-4909-a2b5-ee6bba870234" returned: 0 in 0.542s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:51 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-df25a4f0-5f92-4782-aa42-f68b8bfc07fe tempest-ProjectReaderTests-2080899454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b56a3e51-ce96-4d97-869c-9786a73d5335(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[665b5dda-0943-4c02-bfe4-9f4401e99227]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-df25a4f0-5f92-4782-aa42-f68b8bfc07fe tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:52 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335 Sep 25 17:24:52 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:52 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f50221cf-ea84-46ca-b296-c0b1021dd7f7 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.314s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-f50221cf-ea84-46ca-b296-c0b1021dd7f7 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:52 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-f50221cf-ea84-46ca-b296-c0b1021dd7f7 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Deleted volume successfully. Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-f50221cf-ea84-46ca-b296-c0b1021dd7f7 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-30927b36-365f-49ec-b93e-e83c04a4d246-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:52 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d 1073741824" returned: 0 in 0.541s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:52 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:52 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d Sep 25 17:24:52 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-df25a4f0-5f92-4782-aa42-f68b8bfc07fe tempest-ProjectReaderTests-2080899454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335" returned: 0 in 0.435s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-df25a4f0-5f92-4782-aa42-f68b8bfc07fe tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.f154a5ba-8cce-4909-a2b5-ee6bba870234 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:52 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.f154a5ba-8cce-4909-a2b5-ee6bba870234 Sep 25 17:24:52 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:52 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d" returned: 0 in 0.261s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca92f118-960d-43c7-b164-315bc3d11545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91381c04-1d26-4f28-9a64-dbc33605ae4d', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60110fc0-713d-4467-9380-312b49fb82a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:52 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Volume volume-91381c04-1d26-4f28-9a64-dbc33605ae4d (91381c04-1d26-4f28-9a64-dbc33605ae4d): created successfully Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60110fc0-713d-4467-9380-312b49fb82a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Flow 'volume_create_manager' (c2528cdf-cc35-4721-974d-34a4c31150ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:52 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-5401e11e-4d42-4d42-81c5-10d5c243d491 tempest-ProjectMemberTests-1497756053 None] Created volume successfully. Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e568941a-0056-4b50-9026-bcecb72d273c tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "cinder-5bdef8e9-7536-488e-a364-18462dc87301-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e568941a-0056-4b50-9026-bcecb72d273c tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-5bdef8e9-7536-488e-a364-18462dc87301-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:52 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-df25a4f0-5f92-4782-aa42-f68b8bfc07fe tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.f154a5ba-8cce-4909-a2b5-ee6bba870234" returned: 0 in 0.411s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-df25a4f0-5f92-4782-aa42-f68b8bfc07fe tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.f154a5ba-8cce-4909-a2b5-ee6bba870234 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e568941a-0056-4b50-9026-bcecb72d273c tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "cinder-quobyte-5bdef8e9-7536-488e-a364-18462dc87301" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:52 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.f154a5ba-8cce-4909-a2b5-ee6bba870234 Sep 25 17:24:52 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e568941a-0056-4b50-9026-bcecb72d273c tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-quobyte-5bdef8e9-7536-488e-a364-18462dc87301" acquired by "delete_volume" :: waited 0.017s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[257284a7-a53c-4e64-8f90-c85733155279]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:52 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e568941a-0056-4b50-9026-bcecb72d273c tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bdef8e9-7536-488e-a364-18462dc87301 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:53 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bdef8e9-7536-488e-a364-18462dc87301 Sep 25 17:24:53 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:53 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-df25a4f0-5f92-4782-aa42-f68b8bfc07fe tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335.f154a5ba-8cce-4909-a2b5-ee6bba870234" returned: 0 in 0.285s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-df25a4f0-5f92-4782-aa42-f68b8bfc07fe tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-f154a5ba-8cce-4909-a2b5-ee6bba870234" released by "_delete_snapshot" :: held 1.795s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-df25a4f0-5f92-4782-aa42-f68b8bfc07fe tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-b56a3e51-ce96-4d97-869c-9786a73d5335" released by "delete_snapshot" :: held 1.833s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-df25a4f0-5f92-4782-aa42-f68b8bfc07fe tempest-ProjectReaderTests-2080899454 None] Created reservations ['91415d2e-a54f-4823-8099-54a1e301fdef', 'e6050443-71c2-4f28-8e45-cb60caf38a68', '32b79e3d-0e2c-4b63-91f1-f4c0143c48f1', '7525588e-e25a-4ac1-92c1-1a5c9273e904'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:53 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-df25a4f0-5f92-4782-aa42-f68b8bfc07fe tempest-ProjectReaderTests-2080899454 None] Delete snapshot completed successfully. Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-df25a4f0-5f92-4782-aa42-f68b8bfc07fe tempest-ProjectReaderTests-2080899454 None] Lock "cinder-f154a5ba-8cce-4909-a2b5-ee6bba870234-delete_snapshot" released by "delete_snapshot" :: held 2.013s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:53 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e568941a-0056-4b50-9026-bcecb72d273c tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bdef8e9-7536-488e-a364-18462dc87301" returned: 0 in 0.418s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e568941a-0056-4b50-9026-bcecb72d273c tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bdef8e9-7536-488e-a364-18462dc87301 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:53 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bdef8e9-7536-488e-a364-18462dc87301 Sep 25 17:24:53 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-aef73428-4903-4c01-a62b-d6dfae5195a7 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-b56a3e51-ce96-4d97-869c-9786a73d5335-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-aef73428-4903-4c01-a62b-d6dfae5195a7 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-b56a3e51-ce96-4d97-869c-9786a73d5335-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-aef73428-4903-4c01-a62b-d6dfae5195a7 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-quobyte-b56a3e51-ce96-4d97-869c-9786a73d5335" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-aef73428-4903-4c01-a62b-d6dfae5195a7 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-b56a3e51-ce96-4d97-869c-9786a73d5335" acquired by "delete_volume" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:53 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdd97cb-88d3-4661-b9aa-7f119a7b4216]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aef73428-4903-4c01-a62b-d6dfae5195a7 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e568941a-0056-4b50-9026-bcecb72d273c tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5bdef8e9-7536-488e-a364-18462dc87301" returned: 0 in 0.303s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e568941a-0056-4b50-9026-bcecb72d273c tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-quobyte-5bdef8e9-7536-488e-a364-18462dc87301" released by "delete_volume" :: held 0.777s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:53 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:53 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-e568941a-0056-4b50-9026-bcecb72d273c tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Created reservations ['ce269933-0530-4845-8ffd-48f6838acb03', '143f7c51-b429-46b7-b8af-74ad67306b7a', 'ab98e8fb-ac17-409f-a609-3f868a53d371', '7d5b65ae-2ee2-4f6b-8a5e-fa13345c4322'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:53 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335 Sep 25 17:24:53 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e568941a-0056-4b50-9026-bcecb72d273c tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e568941a-0056-4b50-9026-bcecb72d273c tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e568941a-0056-4b50-9026-bcecb72d273c tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e568941a-0056-4b50-9026-bcecb72d273c tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e568941a-0056-4b50-9026-bcecb72d273c tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e568941a-0056-4b50-9026-bcecb72d273c tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:53 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:53 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-27e5bb27-41e1-4873-87d9-fd1c2f7925c0 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "cinder-19a9a1b6-31cc-4ed3-992d-638085e24146-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:54 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.462s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4a4a9f20-a0fb-4371-971b-486105454873 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4a4a9f20-a0fb-4371-971b-486105454873 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 28 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:24:54 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-27e5bb27-41e1-4873-87d9-fd1c2f7925c0 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-19a9a1b6-31cc-4ed3-992d-638085e24146-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aef73428-4903-4c01-a62b-d6dfae5195a7 tempest-ProjectReaderTests-2080899454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335" returned: 0 in 0.556s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aef73428-4903-4c01-a62b-d6dfae5195a7 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-4a4a9f20-a0fb-4371-971b-486105454873 tempest-ProjectMemberTests-1497756053 None] Creating offline snapshot 99daf47b-1fdd-41f2-9d4c-ea4221257c9a of volume 91381c04-1d26-4f28-9a64-dbc33605ae4d {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:24:54 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335 Sep 25 17:24:54 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:54 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e568941a-0056-4b50-9026-bcecb72d273c tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.378s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-e568941a-0056-4b50-9026-bcecb72d273c tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd4eff0-4c90-42df-9df8-b1591568c7b5]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:54 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-e568941a-0056-4b50-9026-bcecb72d273c tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Deleted volume successfully. Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4a4a9f20-a0fb-4371-971b-486105454873 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-e568941a-0056-4b50-9026-bcecb72d273c tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-5bdef8e9-7536-488e-a364-18462dc87301-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-27e5bb27-41e1-4873-87d9-fd1c2f7925c0 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "cinder-quobyte-19a9a1b6-31cc-4ed3-992d-638085e24146" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-27e5bb27-41e1-4873-87d9-fd1c2f7925c0 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-quobyte-19a9a1b6-31cc-4ed3-992d-638085e24146" acquired by "delete_volume" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[68720059-d782-401c-b24b-3965d8df0892]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-27e5bb27-41e1-4873-87d9-fd1c2f7925c0 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-19a9a1b6-31cc-4ed3-992d-638085e24146 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:54 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d Sep 25 17:24:54 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:54 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-19a9a1b6-31cc-4ed3-992d-638085e24146 Sep 25 17:24:54 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:54 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aef73428-4903-4c01-a62b-d6dfae5195a7 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-b56a3e51-ce96-4d97-869c-9786a73d5335" returned: 0 in 0.309s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-aef73428-4903-4c01-a62b-d6dfae5195a7 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-b56a3e51-ce96-4d97-869c-9786a73d5335" released by "delete_volume" :: held 0.941s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-aef73428-4903-4c01-a62b-d6dfae5195a7 tempest-ProjectReaderTests-2080899454 None] Created reservations ['eae60076-c838-44f6-bb32-22a3fa3ed73d', '829ff347-0335-456b-bab0-19b174074cb7', '1f26d8dd-d603-4403-9c00-c28742a68198', 'b60e986a-605e-49e8-8d47-e8b8c05d0bf9'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-aef73428-4903-4c01-a62b-d6dfae5195a7 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-aef73428-4903-4c01-a62b-d6dfae5195a7 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-aef73428-4903-4c01-a62b-d6dfae5195a7 tempest-ProjectReaderTests-2080899454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-aef73428-4903-4c01-a62b-d6dfae5195a7 tempest-ProjectReaderTests-2080899454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-aef73428-4903-4c01-a62b-d6dfae5195a7 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aef73428-4903-4c01-a62b-d6dfae5195a7 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:54 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:54 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:54 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4a4a9f20-a0fb-4371-971b-486105454873 tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d" returned: 0 in 0.455s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4a4a9f20-a0fb-4371-971b-486105454873 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.99daf47b-1fdd-41f2-9d4c-ea4221257c9a 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:54 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.99daf47b-1fdd-41f2-9d4c-ea4221257c9a 1G Sep 25 17:24:54 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:54 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-27e5bb27-41e1-4873-87d9-fd1c2f7925c0 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-19a9a1b6-31cc-4ed3-992d-638085e24146" returned: 0 in 0.451s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-27e5bb27-41e1-4873-87d9-fd1c2f7925c0 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-19a9a1b6-31cc-4ed3-992d-638085e24146 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:54 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-19a9a1b6-31cc-4ed3-992d-638085e24146 Sep 25 17:24:54 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:54 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-aef73428-4903-4c01-a62b-d6dfae5195a7 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.275s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-aef73428-4903-4c01-a62b-d6dfae5195a7 tempest-ProjectReaderTests-2080899454 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:54 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-aef73428-4903-4c01-a62b-d6dfae5195a7 tempest-ProjectReaderTests-2080899454 None] Deleted volume successfully. Sep 25 17:24:54 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-aef73428-4903-4c01-a62b-d6dfae5195a7 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-b56a3e51-ce96-4d97-869c-9786a73d5335-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:55 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-27e5bb27-41e1-4873-87d9-fd1c2f7925c0 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-19a9a1b6-31cc-4ed3-992d-638085e24146" returned: 0 in 0.283s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-27e5bb27-41e1-4873-87d9-fd1c2f7925c0 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-quobyte-19a9a1b6-31cc-4ed3-992d-638085e24146" released by "delete_volume" :: held 0.786s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-27e5bb27-41e1-4873-87d9-fd1c2f7925c0 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Created reservations ['09a464b1-4dd6-4dbd-acb8-af0c924aeb16', 'e266944d-14eb-4779-8722-064c97fd5bb9', '08752948-e93b-46f6-b66d-c3548c977e1a', 'bdd31c18-2998-48ca-bafa-f1bcbc6ff42f'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:55 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4a4a9f20-a0fb-4371-971b-486105454873 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.99daf47b-1fdd-41f2-9d4c-ea4221257c9a 1G" returned: 0 in 0.462s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4a4a9f20-a0fb-4371-971b-486105454873 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91381c04-1d26-4f28-9a64-dbc33605ae4d -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.99daf47b-1fdd-41f2-9d4c-ea4221257c9a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:55 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91381c04-1d26-4f28-9a64-dbc33605ae4d -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.99daf47b-1fdd-41f2-9d4c-ea4221257c9a Sep 25 17:24:55 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-27e5bb27-41e1-4873-87d9-fd1c2f7925c0 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-27e5bb27-41e1-4873-87d9-fd1c2f7925c0 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-27e5bb27-41e1-4873-87d9-fd1c2f7925c0 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-27e5bb27-41e1-4873-87d9-fd1c2f7925c0 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-27e5bb27-41e1-4873-87d9-fd1c2f7925c0 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-27e5bb27-41e1-4873-87d9-fd1c2f7925c0 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:55 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:55 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a3531c2e-9cbb-4064-8aa2-a5d5ad0ecad8 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "cinder-5312c137-15c1-4716-854e-98ceed75757c-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a3531c2e-9cbb-4064-8aa2-a5d5ad0ecad8 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-5312c137-15c1-4716-854e-98ceed75757c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a3531c2e-9cbb-4064-8aa2-a5d5ad0ecad8 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "cinder-quobyte-5312c137-15c1-4716-854e-98ceed75757c" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a3531c2e-9cbb-4064-8aa2-a5d5ad0ecad8 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-quobyte-5312c137-15c1-4716-854e-98ceed75757c" acquired by "delete_volume" :: waited 0.022s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ca0be1-952b-4046-bac5-06a3b17a446b]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a3531c2e-9cbb-4064-8aa2-a5d5ad0ecad8 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5312c137-15c1-4716-854e-98ceed75757c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:55 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4a4a9f20-a0fb-4371-971b-486105454873 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91381c04-1d26-4f28-9a64-dbc33605ae4d -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.99daf47b-1fdd-41f2-9d4c-ea4221257c9a" returned: 0 in 0.346s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:55 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-4a4a9f20-a0fb-4371-971b-486105454873 tempest-ProjectMemberTests-1497756053 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.99daf47b-1fdd-41f2-9d4c-ea4221257c9a is being set with open permissions: ugo+rw Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4a4a9f20-a0fb-4371-971b-486105454873 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.99daf47b-1fdd-41f2-9d4c-ea4221257c9a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:55 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.99daf47b-1fdd-41f2-9d4c-ea4221257c9a Sep 25 17:24:55 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:55 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-27e5bb27-41e1-4873-87d9-fd1c2f7925c0 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.298s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-27e5bb27-41e1-4873-87d9-fd1c2f7925c0 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:55 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-27e5bb27-41e1-4873-87d9-fd1c2f7925c0 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Deleted volume successfully. Sep 25 17:24:55 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5312c137-15c1-4716-854e-98ceed75757c Sep 25 17:24:55 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-27e5bb27-41e1-4873-87d9-fd1c2f7925c0 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-19a9a1b6-31cc-4ed3-992d-638085e24146-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:55 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4a4a9f20-a0fb-4371-971b-486105454873 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.99daf47b-1fdd-41f2-9d4c-ea4221257c9a" returned: 0 in 0.294s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4a4a9f20-a0fb-4371-971b-486105454873 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:55 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a3531c2e-9cbb-4064-8aa2-a5d5ad0ecad8 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5312c137-15c1-4716-854e-98ceed75757c" returned: 0 in 0.399s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:55 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.info Sep 25 17:24:55 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a3531c2e-9cbb-4064-8aa2-a5d5ad0ecad8 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5312c137-15c1-4716-854e-98ceed75757c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:55 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:55 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5312c137-15c1-4716-854e-98ceed75757c Sep 25 17:24:55 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:56 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4a4a9f20-a0fb-4371-971b-486105454873 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.info" returned: 0 in 0.357s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:56 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-4a4a9f20-a0fb-4371-971b-486105454873 tempest-ProjectMemberTests-1497756053 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.info is being set with open permissions: ugo+rw Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4a4a9f20-a0fb-4371-971b-486105454873 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:56 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a3531c2e-9cbb-4064-8aa2-a5d5ad0ecad8 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-5312c137-15c1-4716-854e-98ceed75757c" returned: 0 in 0.343s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:56 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.info Sep 25 17:24:56 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a3531c2e-9cbb-4064-8aa2-a5d5ad0ecad8 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-quobyte-5312c137-15c1-4716-854e-98ceed75757c" released by "delete_volume" :: held 0.796s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-a3531c2e-9cbb-4064-8aa2-a5d5ad0ecad8 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Created reservations ['4d22c578-8ccc-49c2-a4a9-cde4b73bce55', '602d7d51-8814-49f8-97ab-10d2e4605924', 'be37deae-1c6d-47fd-a68a-f24fec7c2274', 'ff420d2c-a6a2-4f6d-a54d-ee5476bf19be'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Flow 'volume_create_manager' (19d57c5d-e962-47b0-a988-581a91198a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a1e653-44fa-4098-b265-03bc60d877e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a1e653-44fa-4098-b265-03bc60d877e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-501787350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784ceac0fab64f9f842e927c40dac06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:56Z,use_quota=True,user_id='d52e638f870c40eeafb960bab0a3c015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91e9903-6674-4655-a7f0-af8c99c68ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91e9903-6674-4655-a7f0-af8c99c68ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85362675-4521-44ef-a22c-6926dd8ea784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85362675-4521-44ef-a22c-6926dd8ea784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab', 'volume_name': 'volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc75d612-3f67-4318-b08d-e8ed7363fc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc75d612-3f67-4318-b08d-e8ed7363fc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8594a5-b257-4cac-a7bb-c2646059f5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:56 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Volume f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab', 'volume_size': 1} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a3531c2e-9cbb-4064-8aa2-a5d5ad0ecad8 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a3531c2e-9cbb-4064-8aa2-a5d5ad0ecad8 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a3531c2e-9cbb-4064-8aa2-a5d5ad0ecad8 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a3531c2e-9cbb-4064-8aa2-a5d5ad0ecad8 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a3531c2e-9cbb-4064-8aa2-a5d5ad0ecad8 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a3531c2e-9cbb-4064-8aa2-a5d5ad0ecad8 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:56 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:56 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:56 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-83a0573f-0128-4b6e-99c7-0cb4d694a3c2 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "cinder-88d37208-bc95-40a9-bff7-ce32fe18ee82-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-4a4a9f20-a0fb-4371-971b-486105454873 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.info" returned: 0 in 0.334s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-4a4a9f20-a0fb-4371-971b-486105454873 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.408s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.168s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-501787350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784ceac0fab64f9f842e927c40dac06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:56Z,use_quota=True,user_id='d52e638f870c40eeafb960bab0a3c015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Creating volume f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:56 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-83a0573f-0128-4b6e-99c7-0cb4d694a3c2 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-88d37208-bc95-40a9-bff7-ce32fe18ee82-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:56 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab 1073741824 Sep 25 17:24:56 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:56 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-4a4a9f20-a0fb-4371-971b-486105454873 tempest-ProjectMemberTests-1497756053 None] Create snapshot completed successfully Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-83a0573f-0128-4b6e-99c7-0cb4d694a3c2 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "cinder-quobyte-88d37208-bc95-40a9-bff7-ce32fe18ee82" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-83a0573f-0128-4b6e-99c7-0cb4d694a3c2 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-quobyte-88d37208-bc95-40a9-bff7-ce32fe18ee82" acquired by "delete_volume" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d326e62-ffc9-4014-a669-8565628e060b]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-83a0573f-0128-4b6e-99c7-0cb4d694a3c2 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-88d37208-bc95-40a9-bff7-ce32fe18ee82 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:56 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a3531c2e-9cbb-4064-8aa2-a5d5ad0ecad8 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.328s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-a3531c2e-9cbb-4064-8aa2-a5d5ad0ecad8 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:56 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-a3531c2e-9cbb-4064-8aa2-a5d5ad0ecad8 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Deleted volume successfully. Sep 25 17:24:56 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-88d37208-bc95-40a9-bff7-ce32fe18ee82 Sep 25 17:24:56 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:56 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a3531c2e-9cbb-4064-8aa2-a5d5ad0ecad8 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-5312c137-15c1-4716-854e-98ceed75757c-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:57 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab 1073741824" returned: 0 in 0.477s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:57 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-83a0573f-0128-4b6e-99c7-0cb4d694a3c2 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-88d37208-bc95-40a9-bff7-ce32fe18ee82" returned: 0 in 0.415s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-83a0573f-0128-4b6e-99c7-0cb4d694a3c2 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-88d37208-bc95-40a9-bff7-ce32fe18ee82 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:57 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab Sep 25 17:24:57 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:57 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-88d37208-bc95-40a9-bff7-ce32fe18ee82 Sep 25 17:24:57 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9e000763-daf7-4570-8577-9e99f55e4adf tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-99daf47b-1fdd-41f2-9d4c-ea4221257c9a-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9e000763-daf7-4570-8577-9e99f55e4adf tempest-ProjectMemberTests-1497756053 None] Lock "cinder-99daf47b-1fdd-41f2-9d4c-ea4221257c9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9e000763-daf7-4570-8577-9e99f55e4adf tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-91381c04-1d26-4f28-9a64-dbc33605ae4d" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9e000763-daf7-4570-8577-9e99f55e4adf tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-91381c04-1d26-4f28-9a64-dbc33605ae4d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9e000763-daf7-4570-8577-9e99f55e4adf tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-99daf47b-1fdd-41f2-9d4c-ea4221257c9a" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9e000763-daf7-4570-8577-9e99f55e4adf tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-99daf47b-1fdd-41f2-9d4c-ea4221257c9a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-9e000763-daf7-4570-8577-9e99f55e4adf tempest-ProjectMemberTests-1497756053 None] Deleting offline snapshot 99daf47b-1fdd-41f2-9d4c-ea4221257c9a of volume 91381c04-1d26-4f28-9a64-dbc33605ae4d {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:24:57 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-9e000763-daf7-4570-8577-9e99f55e4adf tempest-ProjectMemberTests-1497756053 None] snapshot_file for this snap is: volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.99daf47b-1fdd-41f2-9d4c-ea4221257c9a {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab" returned: 0 in 0.304s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cc13e3-602f-4e7b-a5c9-fb40aad2694c]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e000763-daf7-4570-8577-9e99f55e4adf tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.99daf47b-1fdd-41f2-9d4c-ea4221257c9a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:57 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8594a5-b257-4cac-a7bb-c2646059f5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e246ba4f-e23e-4388-8c3e-3a10c441e90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-83a0573f-0128-4b6e-99c7-0cb4d694a3c2 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-88d37208-bc95-40a9-bff7-ce32fe18ee82" returned: 0 in 0.339s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-83a0573f-0128-4b6e-99c7-0cb4d694a3c2 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-quobyte-88d37208-bc95-40a9-bff7-ce32fe18ee82" released by "delete_volume" :: held 0.807s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:57 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Volume volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab (f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab): created successfully Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e246ba4f-e23e-4388-8c3e-3a10c441e90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Flow 'volume_create_manager' (19d57c5d-e962-47b0-a988-581a91198a10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:57 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-31f3601e-73d1-4463-8983-754437909a37 tempest-ProjectReaderTests-2080899454 None] Created volume successfully. Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-83a0573f-0128-4b6e-99c7-0cb4d694a3c2 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Created reservations ['f0f045e5-810e-4fe0-9a72-5f0b2db616e2', '1725b0ca-74a0-462e-86da-29053dc4d2fd', '90e387d2-237a-4273-91c5-504060a02b5f', 'a239ae59-f124-4871-9138-dc791a6aa26d'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:57 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.99daf47b-1fdd-41f2-9d4c-ea4221257c9a Sep 25 17:24:57 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-83a0573f-0128-4b6e-99c7-0cb4d694a3c2 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-83a0573f-0128-4b6e-99c7-0cb4d694a3c2 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-83a0573f-0128-4b6e-99c7-0cb4d694a3c2 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-83a0573f-0128-4b6e-99c7-0cb4d694a3c2 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-83a0573f-0128-4b6e-99c7-0cb4d694a3c2 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-83a0573f-0128-4b6e-99c7-0cb4d694a3c2 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:57 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:24:57 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:57 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e000763-daf7-4570-8577-9e99f55e4adf tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.99daf47b-1fdd-41f2-9d4c-ea4221257c9a" returned: 0 in 0.432s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-9e000763-daf7-4570-8577-9e99f55e4adf tempest-ProjectMemberTests-1497756053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91381c04-1d26-4f28-9a64-dbc33605ae4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfc1e93-d969-410a-9e04-32b0daf0e816]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e000763-daf7-4570-8577-9e99f55e4adf tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:57 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-83a0573f-0128-4b6e-99c7-0cb4d694a3c2 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.286s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-83a0573f-0128-4b6e-99c7-0cb4d694a3c2 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:57 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-83a0573f-0128-4b6e-99c7-0cb4d694a3c2 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Deleted volume successfully. Sep 25 17:24:57 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-83a0573f-0128-4b6e-99c7-0cb4d694a3c2 tempest-CreateVolumesFromSourceVolumeTest-730877256 None] Lock "cinder-88d37208-bc95-40a9-bff7-ce32fe18ee82-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:58 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d Sep 25 17:24:58 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:58 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e000763-daf7-4570-8577-9e99f55e4adf tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d" returned: 0 in 0.456s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e000763-daf7-4570-8577-9e99f55e4adf tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.99daf47b-1fdd-41f2-9d4c-ea4221257c9a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:58 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.99daf47b-1fdd-41f2-9d4c-ea4221257c9a Sep 25 17:24:58 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f1d8bd8b-1127-433f-8894-e10801a6a312 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f1d8bd8b-1127-433f-8894-e10801a6a312 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:58 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-f1d8bd8b-1127-433f-8894-e10801a6a312 tempest-ProjectReaderTests-2080899454 None] Creating offline snapshot 144cc254-1921-455f-aa4d-0f7767aa7d55 of volume f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:24:58 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd367d45-5eb3-456a-ae55-cb45420a75a8]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f1d8bd8b-1127-433f-8894-e10801a6a312 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:58 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab Sep 25 17:24:58 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:58 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e000763-daf7-4570-8577-9e99f55e4adf tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.99daf47b-1fdd-41f2-9d4c-ea4221257c9a" returned: 0 in 0.496s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:58 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e000763-daf7-4570-8577-9e99f55e4adf tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.99daf47b-1fdd-41f2-9d4c-ea4221257c9a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:58 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.99daf47b-1fdd-41f2-9d4c-ea4221257c9a Sep 25 17:24:58 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:59 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f1d8bd8b-1127-433f-8894-e10801a6a312 tempest-ProjectReaderTests-2080899454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab" returned: 0 in 0.428s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f1d8bd8b-1127-433f-8894-e10801a6a312 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.144cc254-1921-455f-aa4d-0f7767aa7d55 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:59 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.144cc254-1921-455f-aa4d-0f7767aa7d55 1G Sep 25 17:24:59 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:59 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e000763-daf7-4570-8577-9e99f55e4adf tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d.99daf47b-1fdd-41f2-9d4c-ea4221257c9a" returned: 0 in 0.310s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9e000763-daf7-4570-8577-9e99f55e4adf tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-99daf47b-1fdd-41f2-9d4c-ea4221257c9a" released by "_delete_snapshot" :: held 1.825s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9e000763-daf7-4570-8577-9e99f55e4adf tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-91381c04-1d26-4f28-9a64-dbc33605ae4d" released by "delete_snapshot" :: held 1.853s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:59 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-9e000763-daf7-4570-8577-9e99f55e4adf tempest-ProjectMemberTests-1497756053 None] Created reservations ['d8892dfc-99f6-4650-9879-7ca24bc47c4f', '74f11105-8b4c-4052-bd34-a8e41b8b0729', '76052848-c53f-428b-8919-3a091416e1a3', '938152c9-3489-4408-a391-2677801002c9'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:59 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-9e000763-daf7-4570-8577-9e99f55e4adf tempest-ProjectMemberTests-1497756053 None] Delete snapshot completed successfully. Sep 25 17:24:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-9e000763-daf7-4570-8577-9e99f55e4adf tempest-ProjectMemberTests-1497756053 None] Lock "cinder-99daf47b-1fdd-41f2-9d4c-ea4221257c9a-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-904b1024-edb1-4eac-9f47-54f8ed77fc35 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-91381c04-1d26-4f28-9a64-dbc33605ae4d-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-904b1024-edb1-4eac-9f47-54f8ed77fc35 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-91381c04-1d26-4f28-9a64-dbc33605ae4d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-904b1024-edb1-4eac-9f47-54f8ed77fc35 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-91381c04-1d26-4f28-9a64-dbc33605ae4d" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:59 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-904b1024-edb1-4eac-9f47-54f8ed77fc35 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-91381c04-1d26-4f28-9a64-dbc33605ae4d" acquired by "delete_volume" :: waited 0.025s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:59 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f1d8bd8b-1127-433f-8894-e10801a6a312 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.144cc254-1921-455f-aa4d-0f7767aa7d55 1G" returned: 0 in 0.581s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f1d8bd8b-1127-433f-8894-e10801a6a312 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.144cc254-1921-455f-aa4d-0f7767aa7d55 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:59 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9795abc-1b89-4fe2-a23e-3301c7257f89]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-904b1024-edb1-4eac-9f47-54f8ed77fc35 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:59 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.144cc254-1921-455f-aa4d-0f7767aa7d55 Sep 25 17:24:59 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:59 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d Sep 25 17:24:59 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:59 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f1d8bd8b-1127-433f-8894-e10801a6a312 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.144cc254-1921-455f-aa4d-0f7767aa7d55" returned: 0 in 0.334s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:59 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-f1d8bd8b-1127-433f-8894-e10801a6a312 tempest-ProjectReaderTests-2080899454 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.144cc254-1921-455f-aa4d-0f7767aa7d55 is being set with open permissions: ugo+rw Sep 25 17:24:59 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f1d8bd8b-1127-433f-8894-e10801a6a312 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.144cc254-1921-455f-aa4d-0f7767aa7d55 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:00 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.144cc254-1921-455f-aa4d-0f7767aa7d55 Sep 25 17:25:00 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:00 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-904b1024-edb1-4eac-9f47-54f8ed77fc35 tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d" returned: 0 in 0.461s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-904b1024-edb1-4eac-9f47-54f8ed77fc35 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:00 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d Sep 25 17:25:00 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:00 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f1d8bd8b-1127-433f-8894-e10801a6a312 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.144cc254-1921-455f-aa4d-0f7767aa7d55" returned: 0 in 0.288s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f1d8bd8b-1127-433f-8894-e10801a6a312 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:00 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.info Sep 25 17:25:00 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:00 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-904b1024-edb1-4eac-9f47-54f8ed77fc35 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-91381c04-1d26-4f28-9a64-dbc33605ae4d" returned: 0 in 0.280s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-904b1024-edb1-4eac-9f47-54f8ed77fc35 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-91381c04-1d26-4f28-9a64-dbc33605ae4d" released by "delete_volume" :: held 0.826s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:00 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-904b1024-edb1-4eac-9f47-54f8ed77fc35 tempest-ProjectMemberTests-1497756053 None] Created reservations ['ef838a91-417d-4d96-86fc-b39ae70f6a88', 'c824110b-e0dc-46c0-b250-f4e6ab78a854', '664dd59f-c1b6-4e49-b6e6-4164abfd7962', 'ba7e2073-73db-44e6-8f10-1db10c67fc6d'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-904b1024-edb1-4eac-9f47-54f8ed77fc35 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-904b1024-edb1-4eac-9f47-54f8ed77fc35 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:00 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-904b1024-edb1-4eac-9f47-54f8ed77fc35 tempest-ProjectMemberTests-1497756053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:00 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-904b1024-edb1-4eac-9f47-54f8ed77fc35 tempest-ProjectMemberTests-1497756053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-904b1024-edb1-4eac-9f47-54f8ed77fc35 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-904b1024-edb1-4eac-9f47-54f8ed77fc35 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:00 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:25:00 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:00 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f1d8bd8b-1127-433f-8894-e10801a6a312 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.info" returned: 0 in 0.310s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:00 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-f1d8bd8b-1127-433f-8894-e10801a6a312 tempest-ProjectReaderTests-2080899454 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.info is being set with open permissions: ugo+rw Sep 25 17:25:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f1d8bd8b-1127-433f-8894-e10801a6a312 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:00 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.info Sep 25 17:25:00 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:00 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-904b1024-edb1-4eac-9f47-54f8ed77fc35 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.269s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:00 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-904b1024-edb1-4eac-9f47-54f8ed77fc35 tempest-ProjectMemberTests-1497756053 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:00 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-904b1024-edb1-4eac-9f47-54f8ed77fc35 tempest-ProjectMemberTests-1497756053 None] Deleted volume successfully. Sep 25 17:25:00 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-904b1024-edb1-4eac-9f47-54f8ed77fc35 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-91381c04-1d26-4f28-9a64-dbc33605ae4d-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:00 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-f1d8bd8b-1127-433f-8894-e10801a6a312 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.info" returned: 0 in 0.303s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-f1d8bd8b-1127-433f-8894-e10801a6a312 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.357s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:00 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-f1d8bd8b-1127-433f-8894-e10801a6a312 tempest-ProjectReaderTests-2080899454 None] Create snapshot completed successfully Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Flow 'volume_create_manager' (3c2dc6f3-c753-437a-afdd-bc0a57fe1d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (894538af-a629-4502-9d59-f308d8fcd936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (894538af-a629-4502-9d59-f308d8fcd936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-329164851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab55be39-9a4b-4599-b150-d2428d8a1c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31fdfb42d1d48219cd53e16d4a0131f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:01Z,use_quota=True,user_id='645f5007ad61465e9de1ac84410dacf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46510ae0-0ccd-4409-ac89-413fd7fe7279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46510ae0-0ccd-4409-ac89-413fd7fe7279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877fccc0-273e-42b1-af4f-7c50a7072828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877fccc0-273e-42b1-af4f-7c50a7072828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab55be39-9a4b-4599-b150-d2428d8a1c85', 'volume_name': 'volume-ab55be39-9a4b-4599-b150-d2428d8a1c85', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ffecf7-6e51-4455-89eb-5317bf279d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ffecf7-6e51-4455-89eb-5317bf279d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64cf5de2-5a22-4ce6-bcb9-cc3ba8fd9477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:01 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Volume ab55be39-9a4b-4599-b150-d2428d8a1c85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab55be39-9a4b-4599-b150-d2428d8a1c85', 'volume_size': 1} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-329164851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab55be39-9a4b-4599-b150-d2428d8a1c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31fdfb42d1d48219cd53e16d4a0131f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:01Z,use_quota=True,user_id='645f5007ad61465e9de1ac84410dacf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Creating volume ab55be39-9a4b-4599-b150-d2428d8a1c85 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:01 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:01 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85 1073741824 Sep 25 17:25:01 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a782eb18-b5ae-43b8-8bd6-cd20a6b3b9e3 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-144cc254-1921-455f-aa4d-0f7767aa7d55-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a782eb18-b5ae-43b8-8bd6-cd20a6b3b9e3 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-144cc254-1921-455f-aa4d-0f7767aa7d55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a782eb18-b5ae-43b8-8bd6-cd20a6b3b9e3 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-quobyte-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a782eb18-b5ae-43b8-8bd6-cd20a6b3b9e3 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a782eb18-b5ae-43b8-8bd6-cd20a6b3b9e3 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-quobyte-144cc254-1921-455f-aa4d-0f7767aa7d55" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a782eb18-b5ae-43b8-8bd6-cd20a6b3b9e3 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-144cc254-1921-455f-aa4d-0f7767aa7d55" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-a782eb18-b5ae-43b8-8bd6-cd20a6b3b9e3 tempest-ProjectReaderTests-2080899454 None] Deleting offline snapshot 144cc254-1921-455f-aa4d-0f7767aa7d55 of volume f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-a782eb18-b5ae-43b8-8bd6-cd20a6b3b9e3 tempest-ProjectReaderTests-2080899454 None] snapshot_file for this snap is: volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.144cc254-1921-455f-aa4d-0f7767aa7d55 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:25:01 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85 1073741824" returned: 0 in 0.576s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0041a36-8064-42cb-8fa8-66e7dd3b7eae]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a782eb18-b5ae-43b8-8bd6-cd20a6b3b9e3 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.144cc254-1921-455f-aa4d-0f7767aa7d55 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:02 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85 Sep 25 17:25:02 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:02 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.144cc254-1921-455f-aa4d-0f7767aa7d55 Sep 25 17:25:02 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:02 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85" returned: 0 in 0.341s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64cf5de2-5a22-4ce6-bcb9-cc3ba8fd9477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab55be39-9a4b-4599-b150-d2428d8a1c85', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88aa79c2-acea-4923-989a-3da16d81ed13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:02 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Volume volume-ab55be39-9a4b-4599-b150-d2428d8a1c85 (ab55be39-9a4b-4599-b150-d2428d8a1c85): created successfully Sep 25 17:25:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88aa79c2-acea-4923-989a-3da16d81ed13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Flow 'volume_create_manager' (3c2dc6f3-c753-437a-afdd-bc0a57fe1d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:02 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-3f76d1f2-1bcc-46ab-9270-1c659b1a021f tempest-ProjectMemberTests-1497756053 None] Created volume successfully. Sep 25 17:25:02 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a782eb18-b5ae-43b8-8bd6-cd20a6b3b9e3 tempest-ProjectReaderTests-2080899454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.144cc254-1921-455f-aa4d-0f7767aa7d55" returned: 0 in 0.486s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-a782eb18-b5ae-43b8-8bd6-cd20a6b3b9e3 tempest-ProjectReaderTests-2080899454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:25:02 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c82f7f1-b8b3-410a-a110-ccbc37acbfcb]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a782eb18-b5ae-43b8-8bd6-cd20a6b3b9e3 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:02 devstack sudo[108350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab Sep 25 17:25:02 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:02 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a782eb18-b5ae-43b8-8bd6-cd20a6b3b9e3 tempest-ProjectReaderTests-2080899454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab" returned: 0 in 0.380s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a782eb18-b5ae-43b8-8bd6-cd20a6b3b9e3 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.144cc254-1921-455f-aa4d-0f7767aa7d55 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:02 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.144cc254-1921-455f-aa4d-0f7767aa7d55 Sep 25 17:25:02 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:03 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a782eb18-b5ae-43b8-8bd6-cd20a6b3b9e3 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.144cc254-1921-455f-aa4d-0f7767aa7d55" returned: 0 in 0.365s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a782eb18-b5ae-43b8-8bd6-cd20a6b3b9e3 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.144cc254-1921-455f-aa4d-0f7767aa7d55 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:03 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.144cc254-1921-455f-aa4d-0f7767aa7d55 Sep 25 17:25:03 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:03 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a782eb18-b5ae-43b8-8bd6-cd20a6b3b9e3 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab.144cc254-1921-455f-aa4d-0f7767aa7d55" returned: 0 in 0.301s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a782eb18-b5ae-43b8-8bd6-cd20a6b3b9e3 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-144cc254-1921-455f-aa4d-0f7767aa7d55" released by "_delete_snapshot" :: held 1.696s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a782eb18-b5ae-43b8-8bd6-cd20a6b3b9e3 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab" released by "delete_snapshot" :: held 1.732s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:03 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-a782eb18-b5ae-43b8-8bd6-cd20a6b3b9e3 tempest-ProjectReaderTests-2080899454 None] Created reservations ['95982739-8f84-4bb9-8a51-0301ccc64938', 'c78fbf43-dadb-457d-9697-fe84d8e4746c', '6221e48c-34ab-4061-bccf-68c1b27b452b', 'e142181b-aa6e-4497-8c0e-658a70a0bebf'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:03 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-a782eb18-b5ae-43b8-8bd6-cd20a6b3b9e3 tempest-ProjectReaderTests-2080899454 None] Delete snapshot completed successfully. Sep 25 17:25:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a782eb18-b5ae-43b8-8bd6-cd20a6b3b9e3 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-144cc254-1921-455f-aa4d-0f7767aa7d55-delete_snapshot" released by "delete_snapshot" :: held 1.922s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a38a6408-11e3-424d-9d23-527ba53b6410 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a38a6408-11e3-424d-9d23-527ba53b6410 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-a38a6408-11e3-424d-9d23-527ba53b6410 tempest-ProjectMemberTests-1497756053 None] Creating offline snapshot 92db2782-3944-4643-9c26-3e6967c9d871 of volume ab55be39-9a4b-4599-b150-d2428d8a1c85 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:25:03 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d506d6-83b2-4ff0-a816-3ea990742267]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a38a6408-11e3-424d-9d23-527ba53b6410 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:03 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Flow 'volume_create_manager' (62cfa31d-e4ae-4284-ba6b-429a8ad8ae15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2599799a-a430-458a-be09-5ca9d184a638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2599799a-a430-458a-be09-5ca9d184a638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b951fa4-c92e-4116-9b4e-a00d2a375264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee953e4abab8436784bfdf72dec88ce3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:04Z,use_quota=True,user_id='25add9e497a944d78877bbcc6ec6e852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cedbc51b-a40f-4571-8e70-7f243f171bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cedbc51b-a40f-4571-8e70-7f243f171bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c026b5eb-132f-4d33-b2f5-2575dcdefc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:03 devstack cinder-volume[87211]: DEBUG cinder.image.glance [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Creating Keystone auth plugin from conf {{(pid=87211) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 17:25:03 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85 Sep 25 17:25:03 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c047eac8-c1be-4e0e-89ff-94559c90a44d tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c047eac8-c1be-4e0e-89ff-94559c90a44d tempest-ProjectReaderTests-2080899454 None] Lock "cinder-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c047eac8-c1be-4e0e-89ff-94559c90a44d tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-quobyte-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c047eac8-c1be-4e0e-89ff-94559c90a44d tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab" acquired by "delete_volume" :: waited 0.022s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b98375-7db4-4429-83ea-317ae5a69545]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c047eac8-c1be-4e0e-89ff-94559c90a44d tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c026b5eb-132f-4d33-b2f5-2575dcdefc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6b951fa4-c92e-4116-9b4e-a00d2a375264', 'volume_name': 'volume-6b951fa4-c92e-4116-9b4e-a00d2a375264', 'volume_size': 1, 'image_id': '6bb67b6d-47ec-49c1-9522-260b66ceef39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6bb67b6d-47ec-49c1-9522-260b66ceef39', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f7b70e57281950f64fbf694fc442ac5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ee953e4abab8436784bfdf72dec88ce3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9cdb087f457d30536caf8060e1e2c6375d53d1cabef814e432f31bdb237ec7248bc81fd1e9e1feb41ca483930254d7672182b78f10e0592434b671815805e4c8', 'id': '6bb67b6d-47ec-49c1-9522-260b66ceef39', 'created_at': datetime.datetime(2026, 9, 25, 15, 25, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 25, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6bb67b6d-47ec-49c1-9522-260b66ceef39/file', 'properties': {}}, 'image_service': }' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7275e91a-b7a3-4e4a-8518-547d7ee8038b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:04 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7275e91a-b7a3-4e4a-8518-547d7ee8038b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea5fe73f-fa67-435c-87ee-da3d2d2a3c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:04 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Volume 6b951fa4-c92e-4116-9b4e-a00d2a375264: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6b951fa4-c92e-4116-9b4e-a00d2a375264', 'volume_size': 1, 'image_id': '6bb67b6d-47ec-49c1-9522-260b66ceef39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6bb67b6d-47ec-49c1-9522-260b66ceef39', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f7b70e57281950f64fbf694fc442ac5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ee953e4abab8436784bfdf72dec88ce3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9cdb087f457d30536caf8060e1e2c6375d53d1cabef814e432f31bdb237ec7248bc81fd1e9e1feb41ca483930254d7672182b78f10e0592434b671815805e4c8', 'id': '6bb67b6d-47ec-49c1-9522-260b66ceef39', 'created_at': datetime.datetime(2026, 9, 25, 15, 25, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 25, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6bb67b6d-47ec-49c1-9522-260b66ceef39/file', 'properties': {}}, 'image_service': } Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Trying to clone 6b951fa4-c92e-4116-9b4e-a00d2a375264 from image 6bb67b6d-47ec-49c1-9522-260b66ceef39 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6bb67b6d-47ec-49c1-9522-260b66ceef39', 'metadata': {}}]). {{(pid=87211) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a38a6408-11e3-424d-9d23-527ba53b6410 tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85" returned: 0 in 0.470s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a38a6408-11e3-424d-9d23-527ba53b6410 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.92db2782-3944-4643-9c26-3e6967c9d871 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:04 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab Sep 25 17:25:04 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:04 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.92db2782-3944-4643-9c26-3e6967c9d871 1G Sep 25 17:25:04 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 17:25:04 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Image download 0.00 MB at 0.00 MB/s Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1125cba-d2fd-40d4-978d-16c096dfd155]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:04 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD Sep 25 17:25:04 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:04 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c047eac8-c1be-4e0e-89ff-94559c90a44d tempest-ProjectReaderTests-2080899454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab" returned: 0 in 0.469s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c047eac8-c1be-4e0e-89ff-94559c90a44d tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:04 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab Sep 25 17:25:04 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:04 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a38a6408-11e3-424d-9d23-527ba53b6410 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.92db2782-3944-4643-9c26-3e6967c9d871 1G" returned: 0 in 0.478s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a38a6408-11e3-424d-9d23-527ba53b6410 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab55be39-9a4b-4599-b150-d2428d8a1c85 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.92db2782-3944-4643-9c26-3e6967c9d871 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:04 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab55be39-9a4b-4599-b150-d2428d8a1c85 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.92db2782-3944-4643-9c26-3e6967c9d871 Sep 25 17:25:04 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:04 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:04 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c047eac8-c1be-4e0e-89ff-94559c90a44d tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab" returned: 0 in 0.293s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:04 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD Sep 25 17:25:04 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c047eac8-c1be-4e0e-89ff-94559c90a44d tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab" released by "delete_volume" :: held 0.853s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-c047eac8-c1be-4e0e-89ff-94559c90a44d tempest-ProjectReaderTests-2080899454 None] Created reservations ['5a5226cf-fa67-41d7-81e6-bf331538b229', 'd38d3f6e-b049-4363-89a9-5de5fb668eb2', '8bdac629-ce34-4392-952d-35fde4e93997', 'b8d2c3be-6df0-467f-bac3-757388eeebc4'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:05 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a38a6408-11e3-424d-9d23-527ba53b6410 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab55be39-9a4b-4599-b150-d2428d8a1c85 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.92db2782-3944-4643-9c26-3e6967c9d871" returned: 0 in 0.322s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:05 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-a38a6408-11e3-424d-9d23-527ba53b6410 tempest-ProjectMemberTests-1497756053 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.92db2782-3944-4643-9c26-3e6967c9d871 is being set with open permissions: ugo+rw Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a38a6408-11e3-424d-9d23-527ba53b6410 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.92db2782-3944-4643-9c26-3e6967c9d871 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:05 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.92db2782-3944-4643-9c26-3e6967c9d871 Sep 25 17:25:05 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c047eac8-c1be-4e0e-89ff-94559c90a44d tempest-ProjectReaderTests-2080899454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c047eac8-c1be-4e0e-89ff-94559c90a44d tempest-ProjectReaderTests-2080899454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c047eac8-c1be-4e0e-89ff-94559c90a44d tempest-ProjectReaderTests-2080899454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-c047eac8-c1be-4e0e-89ff-94559c90a44d tempest-ProjectReaderTests-2080899454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-c047eac8-c1be-4e0e-89ff-94559c90a44d tempest-ProjectReaderTests-2080899454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c047eac8-c1be-4e0e-89ff-94559c90a44d tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:05 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:25:05 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:05 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD" returned: 1 in 0.472s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Temporary image 6bb67b6d-47ec-49c1-9522-260b66ceef39 is fetched for user 25add9e497a944d78877bbcc6ec6e852. {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 17:25:05 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a38a6408-11e3-424d-9d23-527ba53b6410 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.92db2782-3944-4643-9c26-3e6967c9d871" returned: 0 in 0.287s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0036a3-ca8d-40d3-9e3b-6f9c32a70446]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:05 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a38a6408-11e3-424d-9d23-527ba53b6410 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-c047eac8-c1be-4e0e-89ff-94559c90a44d tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.301s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-c047eac8-c1be-4e0e-89ff-94559c90a44d tempest-ProjectReaderTests-2080899454 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:05 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-c047eac8-c1be-4e0e-89ff-94559c90a44d tempest-ProjectReaderTests-2080899454 None] Deleted volume successfully. Sep 25 17:25:05 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.info Sep 25 17:25:05 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-c047eac8-c1be-4e0e-89ff-94559c90a44d tempest-ProjectReaderTests-2080899454 None] Lock "cinder-f4aa6c98-b8ec-4b25-8de7-9e67c2fe25ab-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:05 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD Sep 25 17:25:05 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:05 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Flow 'volume_create_manager' (91b5a1a1-838a-491f-ba00-12289c89b823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37433aa8-99ad-4c3d-aadd-32a3c015d3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a38a6408-11e3-424d-9d23-527ba53b6410 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.info" returned: 0 in 0.383s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:05 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-a38a6408-11e3-424d-9d23-527ba53b6410 tempest-ProjectMemberTests-1497756053 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.info is being set with open permissions: ugo+rw Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a38a6408-11e3-424d-9d23-527ba53b6410 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:05 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:05 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.info Sep 25 17:25:05 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37433aa8-99ad-4c3d-aadd-32a3c015d3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1695899079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685f0f12-ded4-4ca7-8ea9-197c1451448c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784ceac0fab64f9f842e927c40dac06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:06Z,use_quota=True,user_id='d52e638f870c40eeafb960bab0a3c015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68179a3-4c3b-48bc-b6a9-6d27b05ba8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68179a3-4c3b-48bc-b6a9-6d27b05ba8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11bb3d4f-662d-45bd-b04c-da8c0cabfb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11bb3d4f-662d-45bd-b04c-da8c0cabfb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '685f0f12-ded4-4ca7-8ea9-197c1451448c', 'volume_name': 'volume-685f0f12-ded4-4ca7-8ea9-197c1451448c', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b622c80-86c2-48d7-9970-8c2bee204b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b622c80-86c2-48d7-9970-8c2bee204b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f293bbd7-3124-47e0-9f0d-554f9ae7c365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:05 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Volume 685f0f12-ded4-4ca7-8ea9-197c1451448c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-685f0f12-ded4-4ca7-8ea9-197c1451448c', 'volume_size': 1} Sep 25 17:25:05 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:05 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD Sep 25 17:25:05 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:06 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a38a6408-11e3-424d-9d23-527ba53b6410 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.info" returned: 0 in 0.258s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a38a6408-11e3-424d-9d23-527ba53b6410 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.313s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.204s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1695899079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685f0f12-ded4-4ca7-8ea9-197c1451448c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784ceac0fab64f9f842e927c40dac06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:06Z,use_quota=True,user_id='d52e638f870c40eeafb960bab0a3c015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Creating volume 685f0f12-ded4-4ca7-8ea9-197c1451448c {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:06 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:06 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c 1073741824 Sep 25 17:25:06 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:06 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-a38a6408-11e3-424d-9d23-527ba53b6410 tempest-ProjectMemberTests-1497756053 None] Create snapshot completed successfully Sep 25 17:25:06 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:06 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c 1073741824" returned: 0 in 0.424s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:06 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c Sep 25 17:25:06 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0a5458b3-ba58-4032-8a86-7f4079579e33 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-92db2782-3944-4643-9c26-3e6967c9d871-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0a5458b3-ba58-4032-8a86-7f4079579e33 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-92db2782-3944-4643-9c26-3e6967c9d871-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0a5458b3-ba58-4032-8a86-7f4079579e33 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-ab55be39-9a4b-4599-b150-d2428d8a1c85" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0a5458b3-ba58-4032-8a86-7f4079579e33 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-ab55be39-9a4b-4599-b150-d2428d8a1c85" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0a5458b3-ba58-4032-8a86-7f4079579e33 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-92db2782-3944-4643-9c26-3e6967c9d871" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0a5458b3-ba58-4032-8a86-7f4079579e33 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-92db2782-3944-4643-9c26-3e6967c9d871" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-0a5458b3-ba58-4032-8a86-7f4079579e33 tempest-ProjectMemberTests-1497756053 None] Deleting offline snapshot 92db2782-3944-4643-9c26-3e6967c9d871 of volume ab55be39-9a4b-4599-b150-d2428d8a1c85 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-0a5458b3-ba58-4032-8a86-7f4079579e33 tempest-ProjectMemberTests-1497756053 None] snapshot_file for this snap is: volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.92db2782-3944-4643-9c26-3e6967c9d871 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[20684a05-fb87-4655-8946-5228d82f362f]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0a5458b3-ba58-4032-8a86-7f4079579e33 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.92db2782-3944-4643-9c26-3e6967c9d871 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:06 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c" returned: 0 in 0.340s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.722s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b951fa4-c92e-4116-9b4e-a00d2a375264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee953e4abab8436784bfdf72dec88ce3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:04Z,use_quota=True,user_id='25add9e497a944d78877bbcc6ec6e852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Creating volume 6b951fa4-c92e-4116-9b4e-a00d2a375264 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:06 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6b951fa4-c92e-4116-9b4e-a00d2a375264 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f293bbd7-3124-47e0-9f0d-554f9ae7c365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-685f0f12-ded4-4ca7-8ea9-197c1451448c', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d743d48f-936b-4cb7-a8e7-277e933fb339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:06 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6b951fa4-c92e-4116-9b4e-a00d2a375264 1073741824 Sep 25 17:25:06 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:06 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Volume volume-685f0f12-ded4-4ca7-8ea9-197c1451448c (685f0f12-ded4-4ca7-8ea9-197c1451448c): created successfully Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d743d48f-936b-4cb7-a8e7-277e933fb339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:06 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Flow 'volume_create_manager' (91b5a1a1-838a-491f-ba00-12289c89b823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:06 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-e25bae95-184e-4449-ad48-8f90eeb109e7 tempest-ProjectReaderTests-2080899454 None] Created volume successfully. Sep 25 17:25:07 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.92db2782-3944-4643-9c26-3e6967c9d871 Sep 25 17:25:07 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:07 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0a5458b3-ba58-4032-8a86-7f4079579e33 tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.92db2782-3944-4643-9c26-3e6967c9d871" returned: 0 in 0.436s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-0a5458b3-ba58-4032-8a86-7f4079579e33 tempest-ProjectMemberTests-1497756053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab55be39-9a4b-4599-b150-d2428d8a1c85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:25:07 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c26e5ec-e0ca-412d-ba8e-8c0014059f45]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0a5458b3-ba58-4032-8a86-7f4079579e33 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:07 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6b951fa4-c92e-4116-9b4e-a00d2a375264 1073741824" returned: 0 in 0.480s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6b951fa4-c92e-4116-9b4e-a00d2a375264 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:07 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6b951fa4-c92e-4116-9b4e-a00d2a375264 Sep 25 17:25:07 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:07 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85 Sep 25 17:25:07 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:07 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6b951fa4-c92e-4116-9b4e-a00d2a375264" returned: 0 in 0.266s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:07 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:07 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Attempting download of 6bb67b6d-47ec-49c1-9522-260b66ceef39 ((None, [{'url': 'file:///opt/stack/data/glance/images/6bb67b6d-47ec-49c1-9522-260b66ceef39', 'metadata': {}}])) to volume 6b951fa4-c92e-4116-9b4e-a00d2a375264. {{(pid=87211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 17:25:07 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0a5458b3-ba58-4032-8a86-7f4079579e33 tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85" returned: 0 in 0.419s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0a5458b3-ba58-4032-8a86-7f4079579e33 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.92db2782-3944-4643-9c26-3e6967c9d871 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:07 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.92db2782-3944-4643-9c26-3e6967c9d871 Sep 25 17:25:07 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:07 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c79d16-ac19-470a-a61f-0175d2878343]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:07 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6bb67b6d-47ec-49c1-9522-260b66ceef39_sehoadfx {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:07 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6bb67b6d-47ec-49c1-9522-260b66ceef39_sehoadfx Sep 25 17:25:07 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-112670b1-30fd-42ed-9ade-a70b99283ff8 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-112670b1-30fd-42ed-9ade-a70b99283ff8 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:08 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-112670b1-30fd-42ed-9ade-a70b99283ff8 tempest-ProjectReaderTests-2080899454 None] Creating offline snapshot 0f594a7d-0011-4df1-a26d-db7313eda973 of volume 685f0f12-ded4-4ca7-8ea9-197c1451448c {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:25:08 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22d625c-2983-4370-979e-d84df83a1b4b]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-112670b1-30fd-42ed-9ade-a70b99283ff8 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:08 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6bb67b6d-47ec-49c1-9522-260b66ceef39_sehoadfx" returned: 0 in 0.394s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6bb67b6d-47ec-49c1-9522-260b66ceef39_sehoadfx {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:08 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0a5458b3-ba58-4032-8a86-7f4079579e33 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.92db2782-3944-4643-9c26-3e6967c9d871" returned: 0 in 0.455s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0a5458b3-ba58-4032-8a86-7f4079579e33 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.92db2782-3944-4643-9c26-3e6967c9d871 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:08 devstack sudo[108457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.92db2782-3944-4643-9c26-3e6967c9d871 Sep 25 17:25:08 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:08 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c Sep 25 17:25:08 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:08 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6bb67b6d-47ec-49c1-9522-260b66ceef39_sehoadfx Sep 25 17:25:08 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:08 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0a5458b3-ba58-4032-8a86-7f4079579e33 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85.92db2782-3944-4643-9c26-3e6967c9d871" returned: 0 in 0.269s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0a5458b3-ba58-4032-8a86-7f4079579e33 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-92db2782-3944-4643-9c26-3e6967c9d871" released by "_delete_snapshot" :: held 1.690s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0a5458b3-ba58-4032-8a86-7f4079579e33 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-ab55be39-9a4b-4599-b150-d2428d8a1c85" released by "delete_snapshot" :: held 1.713s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:08 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6bb67b6d-47ec-49c1-9522-260b66ceef39_sehoadfx" returned: 1 in 0.368s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6bb67b6d-47ec-49c1-9522-260b66ceef39_sehoadfx' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:25:08 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:08 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd74d0a-6341-4beb-aade-9a92ee046723]: (4, 'raw') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-112670b1-30fd-42ed-9ade-a70b99283ff8 tempest-ProjectReaderTests-2080899454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c" returned: 0 in 0.428s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:08 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-112670b1-30fd-42ed-9ade-a70b99283ff8 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.0f594a7d-0011-4df1-a26d-db7313eda973 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:08 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.0f594a7d-0011-4df1-a26d-db7313eda973 1G Sep 25 17:25:08 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:08 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-0a5458b3-ba58-4032-8a86-7f4079579e33 tempest-ProjectMemberTests-1497756053 None] Created reservations ['18b0ee35-6ddf-4cf2-b423-58ffd97e3d84', '69208d17-7f42-4d5d-b920-9357053569ef', 'f751e685-3ee4-4601-9307-751e9be77c81', '7c347b1f-b5b7-4cbd-b1b5-1963dc080438'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:08 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-0a5458b3-ba58-4032-8a86-7f4079579e33 tempest-ProjectMemberTests-1497756053 None] Delete snapshot completed successfully. Sep 25 17:25:08 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0a5458b3-ba58-4032-8a86-7f4079579e33 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-92db2782-3944-4643-9c26-3e6967c9d871-delete_snapshot" released by "delete_snapshot" :: held 1.910s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:08 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD Sep 25 17:25:08 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:09 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-43f3d7cc-4e2e-4e24-8464-f7bf14c64662 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-ab55be39-9a4b-4599-b150-d2428d8a1c85-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:09 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-43f3d7cc-4e2e-4e24-8464-f7bf14c64662 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-ab55be39-9a4b-4599-b150-d2428d8a1c85-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:09 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:09 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-43f3d7cc-4e2e-4e24-8464-f7bf14c64662 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-ab55be39-9a4b-4599-b150-d2428d8a1c85" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:09 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-43f3d7cc-4e2e-4e24-8464-f7bf14c64662 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-ab55be39-9a4b-4599-b150-d2428d8a1c85" acquired by "delete_volume" :: waited 0.027s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:09 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-112670b1-30fd-42ed-9ade-a70b99283ff8 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.0f594a7d-0011-4df1-a26d-db7313eda973 1G" returned: 0 in 0.584s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-112670b1-30fd-42ed-9ade-a70b99283ff8 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-685f0f12-ded4-4ca7-8ea9-197c1451448c -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.0f594a7d-0011-4df1-a26d-db7313eda973 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:09 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD Sep 25 17:25:09 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:09 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7c55dc-720e-4676-bc89-846dbe5eb703]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-43f3d7cc-4e2e-4e24-8464-f7bf14c64662 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:09 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-685f0f12-ded4-4ca7-8ea9-197c1451448c -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.0f594a7d-0011-4df1-a26d-db7313eda973 Sep 25 17:25:09 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:09 devstack sudo[108480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85 Sep 25 17:25:09 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:09 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:25:09 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] 6bb67b6d-47ec-49c1-9522-260b66ceef39 was raw, converting to qcow2 {{(pid=87211) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 17:25:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6b951fa4-c92e-4116-9b4e-a00d2a375264 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:09 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6b951fa4-c92e-4116-9b4e-a00d2a375264 Sep 25 17:25:09 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:09 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-112670b1-30fd-42ed-9ade-a70b99283ff8 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-685f0f12-ded4-4ca7-8ea9-197c1451448c -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.0f594a7d-0011-4df1-a26d-db7313eda973" returned: 0 in 0.378s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:09 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-112670b1-30fd-42ed-9ade-a70b99283ff8 tempest-ProjectReaderTests-2080899454 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.0f594a7d-0011-4df1-a26d-db7313eda973 is being set with open permissions: ugo+rw Sep 25 17:25:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-112670b1-30fd-42ed-9ade-a70b99283ff8 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.0f594a7d-0011-4df1-a26d-db7313eda973 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:09 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.0f594a7d-0011-4df1-a26d-db7313eda973 Sep 25 17:25:09 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:09 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-43f3d7cc-4e2e-4e24-8464-f7bf14c64662 tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85" returned: 0 in 0.450s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-43f3d7cc-4e2e-4e24-8464-f7bf14c64662 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:09 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85 Sep 25 17:25:09 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:09 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-112670b1-30fd-42ed-9ade-a70b99283ff8 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.0f594a7d-0011-4df1-a26d-db7313eda973" returned: 0 in 0.297s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-112670b1-30fd-42ed-9ade-a70b99283ff8 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:09 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.info Sep 25 17:25:09 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:09 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:09 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-43f3d7cc-4e2e-4e24-8464-f7bf14c64662 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-ab55be39-9a4b-4599-b150-d2428d8a1c85" returned: 0 in 0.286s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:09 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-43f3d7cc-4e2e-4e24-8464-f7bf14c64662 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-ab55be39-9a4b-4599-b150-d2428d8a1c85" released by "delete_volume" :: held 0.842s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:10 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-43f3d7cc-4e2e-4e24-8464-f7bf14c64662 tempest-ProjectMemberTests-1497756053 None] Created reservations ['897450a7-d208-4909-93a5-db016f609ff1', 'ff2a6e19-7d9c-4d82-8507-ddedf53a8026', '31ea5005-6dd9-45df-b8e1-69f74df04df1', '52c8f874-2095-441b-9eb3-29fabc2907de'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6b951fa4-c92e-4116-9b4e-a00d2a375264" returned: 0 in 0.637s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6bb67b6d-47ec-49c1-9522-260b66ceef39_3yvjcbjhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6b951fa4-c92e-4116-9b4e-a00d2a375264 {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:25:10 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6b951fa4-c92e-4116-9b4e-a00d2a375264 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:10 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6b951fa4-c92e-4116-9b4e-a00d2a375264 1G Sep 25 17:25:10 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-43f3d7cc-4e2e-4e24-8464-f7bf14c64662 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-43f3d7cc-4e2e-4e24-8464-f7bf14c64662 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-43f3d7cc-4e2e-4e24-8464-f7bf14c64662 tempest-ProjectMemberTests-1497756053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-43f3d7cc-4e2e-4e24-8464-f7bf14c64662 tempest-ProjectMemberTests-1497756053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-43f3d7cc-4e2e-4e24-8464-f7bf14c64662 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-43f3d7cc-4e2e-4e24-8464-f7bf14c64662 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:10 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:25:10 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:10 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-112670b1-30fd-42ed-9ade-a70b99283ff8 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.info" returned: 0 in 0.402s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:10 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-112670b1-30fd-42ed-9ade-a70b99283ff8 tempest-ProjectReaderTests-2080899454 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.info is being set with open permissions: ugo+rw Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-112670b1-30fd-42ed-9ade-a70b99283ff8 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:10 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.info Sep 25 17:25:10 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:10 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6b951fa4-c92e-4116-9b4e-a00d2a375264 1G" returned: 0 in 0.402s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Downloaded image 6bb67b6d-47ec-49c1-9522-260b66ceef39 ((None, [{'url': 'file:///opt/stack/data/glance/images/6bb67b6d-47ec-49c1-9522-260b66ceef39', 'metadata': {}}])) to volume 6b951fa4-c92e-4116-9b4e-a00d2a375264 successfully. {{(pid=87211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Temporary image 6bb67b6d-47ec-49c1-9522-260b66ceef39 for user 25add9e497a944d78877bbcc6ec6e852 is deleted. {{(pid=87211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG cinder.volume.volume_utils [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Marking volume 6b951fa4-c92e-4116-9b4e-a00d2a375264 as bootable. {{(pid=87211) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Copying metadata from image 6bb67b6d-47ec-49c1-9522-260b66ceef39 to 6b951fa4-c92e-4116-9b4e-a00d2a375264. {{(pid=87211) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Creating volume glance metadata for volume 6b951fa4-c92e-4116-9b4e-a00d2a375264 backed by image 6bb67b6d-47ec-49c1-9522-260b66ceef39 with: {'image_id': '6bb67b6d-47ec-49c1-9522-260b66ceef39', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f7b70e57281950f64fbf694fc442ac5d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87211) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 17:25:10 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-43f3d7cc-4e2e-4e24-8464-f7bf14c64662 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.296s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-43f3d7cc-4e2e-4e24-8464-f7bf14c64662 tempest-ProjectMemberTests-1497756053 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:10 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-43f3d7cc-4e2e-4e24-8464-f7bf14c64662 tempest-ProjectMemberTests-1497756053 None] Deleted volume successfully. Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-43f3d7cc-4e2e-4e24-8464-f7bf14c64662 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-ab55be39-9a4b-4599-b150-d2428d8a1c85-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:10 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-112670b1-30fd-42ed-9ade-a70b99283ff8 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.info" returned: 0 in 0.317s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-112670b1-30fd-42ed-9ade-a70b99283ff8 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.500s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea5fe73f-fa67-435c-87ee-da3d2d2a3c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b951fa4-c92e-4116-9b4e-a00d2a375264', 'volume_size': 1, 'image_id': '6bb67b6d-47ec-49c1-9522-260b66ceef39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6bb67b6d-47ec-49c1-9522-260b66ceef39', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f7b70e57281950f64fbf694fc442ac5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ee953e4abab8436784bfdf72dec88ce3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9cdb087f457d30536caf8060e1e2c6375d53d1cabef814e432f31bdb237ec7248bc81fd1e9e1feb41ca483930254d7672182b78f10e0592434b671815805e4c8', 'id': '6bb67b6d-47ec-49c1-9522-260b66ceef39', 'created_at': datetime.datetime(2026, 9, 25, 15, 25, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 25, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6bb67b6d-47ec-49c1-9522-260b66ceef39/file', 'properties': {}}, 'image_service': }' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d75467-8747-48f0-9af4-c73d91df19d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:10 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Volume volume-6b951fa4-c92e-4116-9b4e-a00d2a375264 (6b951fa4-c92e-4116-9b4e-a00d2a375264): created successfully Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d75467-8747-48f0-9af4-c73d91df19d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:10 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Flow 'volume_create_manager' (62cfa31d-e4ae-4284-ba6b-429a8ad8ae15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:10 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-112670b1-30fd-42ed-9ade-a70b99283ff8 tempest-ProjectReaderTests-2080899454 None] Create snapshot completed successfully Sep 25 17:25:10 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-884e6e65-a927-47ac-90f8-328a97e7cdf9 tempest-VolumeImageDependencyTests-1984804597 None] Created volume successfully. Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1bd3a812-83c2-46ca-990e-eb5e3cbdf84d tempest-VolumeImageDependencyTests-1984804597 None] Acquiring lock "cinder-6b951fa4-c92e-4116-9b4e-a00d2a375264-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1bd3a812-83c2-46ca-990e-eb5e3cbdf84d tempest-VolumeImageDependencyTests-1984804597 None] Lock "cinder-6b951fa4-c92e-4116-9b4e-a00d2a375264-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1bd3a812-83c2-46ca-990e-eb5e3cbdf84d tempest-VolumeImageDependencyTests-1984804597 None] Acquiring lock "cinder-quobyte-6b951fa4-c92e-4116-9b4e-a00d2a375264" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1bd3a812-83c2-46ca-990e-eb5e3cbdf84d tempest-VolumeImageDependencyTests-1984804597 None] Lock "cinder-quobyte-6b951fa4-c92e-4116-9b4e-a00d2a375264" acquired by "delete_volume" :: waited 0.024s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[56794d5b-8843-4b43-8355-325f6954a37b]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1bd3a812-83c2-46ca-990e-eb5e3cbdf84d tempest-VolumeImageDependencyTests-1984804597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6b951fa4-c92e-4116-9b4e-a00d2a375264 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fe0b64d7-6696-4a0f-8d5b-f475b62a2e47 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-0f594a7d-0011-4df1-a26d-db7313eda973-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fe0b64d7-6696-4a0f-8d5b-f475b62a2e47 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-0f594a7d-0011-4df1-a26d-db7313eda973-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fe0b64d7-6696-4a0f-8d5b-f475b62a2e47 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-quobyte-685f0f12-ded4-4ca7-8ea9-197c1451448c" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fe0b64d7-6696-4a0f-8d5b-f475b62a2e47 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-685f0f12-ded4-4ca7-8ea9-197c1451448c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fe0b64d7-6696-4a0f-8d5b-f475b62a2e47 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-quobyte-0f594a7d-0011-4df1-a26d-db7313eda973" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fe0b64d7-6696-4a0f-8d5b-f475b62a2e47 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-0f594a7d-0011-4df1-a26d-db7313eda973" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-fe0b64d7-6696-4a0f-8d5b-f475b62a2e47 tempest-ProjectReaderTests-2080899454 None] Deleting offline snapshot 0f594a7d-0011-4df1-a26d-db7313eda973 of volume 685f0f12-ded4-4ca7-8ea9-197c1451448c {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-fe0b64d7-6696-4a0f-8d5b-f475b62a2e47 tempest-ProjectReaderTests-2080899454 None] snapshot_file for this snap is: volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.0f594a7d-0011-4df1-a26d-db7313eda973 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:25:11 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6b951fa4-c92e-4116-9b4e-a00d2a375264 Sep 25 17:25:11 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4010ab-6c38-4c01-902f-1e23d2d19431]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fe0b64d7-6696-4a0f-8d5b-f475b62a2e47 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.0f594a7d-0011-4df1-a26d-db7313eda973 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:11 devstack sudo[108520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.0f594a7d-0011-4df1-a26d-db7313eda973 Sep 25 17:25:11 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Flow 'volume_create_manager' (582d9b9f-348a-4a25-a7b7-04cca24ed0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c677eff6-46ac-4de0-91d7-8570e689bf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c677eff6-46ac-4de0-91d7-8570e689bf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-14814146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb155c3-aa94-47b3-9f26-71a9563bb7be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31fdfb42d1d48219cd53e16d4a0131f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:12Z,use_quota=True,user_id='645f5007ad61465e9de1ac84410dacf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a6bae7-3e56-4c79-997d-f38256620d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a6bae7-3e56-4c79-997d-f38256620d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b370fe-5837-44d7-bb9f-4992717e08d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b370fe-5837-44d7-bb9f-4992717e08d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afb155c3-aa94-47b3-9f26-71a9563bb7be', 'volume_name': 'volume-afb155c3-aa94-47b3-9f26-71a9563bb7be', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:11 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b24a2a-2f59-4ddc-b286-eec6218e1eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b24a2a-2f59-4ddc-b286-eec6218e1eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee84bb72-7373-40fc-b662-938ba27f556f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:11 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Volume afb155c3-aa94-47b3-9f26-71a9563bb7be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afb155c3-aa94-47b3-9f26-71a9563bb7be', 'volume_size': 1} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-14814146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb155c3-aa94-47b3-9f26-71a9563bb7be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31fdfb42d1d48219cd53e16d4a0131f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:12Z,use_quota=True,user_id='645f5007ad61465e9de1ac84410dacf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Creating volume afb155c3-aa94-47b3-9f26-71a9563bb7be {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:11 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:11 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1bd3a812-83c2-46ca-990e-eb5e3cbdf84d tempest-VolumeImageDependencyTests-1984804597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6b951fa4-c92e-4116-9b4e-a00d2a375264" returned: 0 in 0.512s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1bd3a812-83c2-46ca-990e-eb5e3cbdf84d tempest-VolumeImageDependencyTests-1984804597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6b951fa4-c92e-4116-9b4e-a00d2a375264 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:12 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be 1073741824 Sep 25 17:25:12 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:12 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6b951fa4-c92e-4116-9b4e-a00d2a375264 Sep 25 17:25:12 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:12 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fe0b64d7-6696-4a0f-8d5b-f475b62a2e47 tempest-ProjectReaderTests-2080899454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.0f594a7d-0011-4df1-a26d-db7313eda973" returned: 0 in 0.433s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-fe0b64d7-6696-4a0f-8d5b-f475b62a2e47 tempest-ProjectReaderTests-2080899454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-685f0f12-ded4-4ca7-8ea9-197c1451448c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:25:12 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[da97ab77-de9a-4e96-8079-5b4cdbadde71]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fe0b64d7-6696-4a0f-8d5b-f475b62a2e47 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:12 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:12 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c Sep 25 17:25:12 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1bd3a812-83c2-46ca-990e-eb5e3cbdf84d tempest-VolumeImageDependencyTests-1984804597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6b951fa4-c92e-4116-9b4e-a00d2a375264" returned: 0 in 0.277s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1bd3a812-83c2-46ca-990e-eb5e3cbdf84d tempest-VolumeImageDependencyTests-1984804597 None] Lock "cinder-quobyte-6b951fa4-c92e-4116-9b4e-a00d2a375264" released by "delete_volume" :: held 0.857s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:12 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-1bd3a812-83c2-46ca-990e-eb5e3cbdf84d tempest-VolumeImageDependencyTests-1984804597 None] Created reservations ['50fe4fb9-5790-465a-b729-e423a4e35717', '68c028d4-2a1f-487e-a512-174dbe4ffbec', 'a8943db9-8ebe-4bf1-85bc-e549648416b6', 'b04c7cba-ede4-4638-aca6-87efa78ca906'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1bd3a812-83c2-46ca-990e-eb5e3cbdf84d tempest-VolumeImageDependencyTests-1984804597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1bd3a812-83c2-46ca-990e-eb5e3cbdf84d tempest-VolumeImageDependencyTests-1984804597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1bd3a812-83c2-46ca-990e-eb5e3cbdf84d tempest-VolumeImageDependencyTests-1984804597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:12 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-1bd3a812-83c2-46ca-990e-eb5e3cbdf84d tempest-VolumeImageDependencyTests-1984804597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-1bd3a812-83c2-46ca-990e-eb5e3cbdf84d tempest-VolumeImageDependencyTests-1984804597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1bd3a812-83c2-46ca-990e-eb5e3cbdf84d tempest-VolumeImageDependencyTests-1984804597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:12 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:25:12 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:12 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be 1073741824" returned: 0 in 0.655s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:12 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fe0b64d7-6696-4a0f-8d5b-f475b62a2e47 tempest-ProjectReaderTests-2080899454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c" returned: 0 in 0.545s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fe0b64d7-6696-4a0f-8d5b-f475b62a2e47 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.0f594a7d-0011-4df1-a26d-db7313eda973 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:12 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.0f594a7d-0011-4df1-a26d-db7313eda973 Sep 25 17:25:12 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:12 devstack sudo[108617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be Sep 25 17:25:12 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:12 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:12 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-1bd3a812-83c2-46ca-990e-eb5e3cbdf84d tempest-VolumeImageDependencyTests-1984804597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.419s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:12 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-1bd3a812-83c2-46ca-990e-eb5e3cbdf84d tempest-VolumeImageDependencyTests-1984804597 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:12 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-1bd3a812-83c2-46ca-990e-eb5e3cbdf84d tempest-VolumeImageDependencyTests-1984804597 None] Deleted volume successfully. Sep 25 17:25:12 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-1bd3a812-83c2-46ca-990e-eb5e3cbdf84d tempest-VolumeImageDependencyTests-1984804597 None] Lock "cinder-6b951fa4-c92e-4116-9b4e-a00d2a375264-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:13 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be" returned: 0 in 0.409s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:13 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee84bb72-7373-40fc-b662-938ba27f556f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afb155c3-aa94-47b3-9f26-71a9563bb7be', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6ff302-3ac8-4e98-8624-eef2bff40a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:13 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Volume volume-afb155c3-aa94-47b3-9f26-71a9563bb7be (afb155c3-aa94-47b3-9f26-71a9563bb7be): created successfully Sep 25 17:25:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6ff302-3ac8-4e98-8624-eef2bff40a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:13 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Flow 'volume_create_manager' (582d9b9f-348a-4a25-a7b7-04cca24ed0d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:13 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-996481e4-7437-4c27-b32e-bc4986128890 tempest-ProjectMemberTests-1497756053 None] Created volume successfully. Sep 25 17:25:13 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fe0b64d7-6696-4a0f-8d5b-f475b62a2e47 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.0f594a7d-0011-4df1-a26d-db7313eda973" returned: 0 in 0.585s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fe0b64d7-6696-4a0f-8d5b-f475b62a2e47 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.0f594a7d-0011-4df1-a26d-db7313eda973 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:13 devstack sudo[108893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.0f594a7d-0011-4df1-a26d-db7313eda973 Sep 25 17:25:13 devstack sudo[108893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:13 devstack sudo[108893]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:13 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fe0b64d7-6696-4a0f-8d5b-f475b62a2e47 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c.0f594a7d-0011-4df1-a26d-db7313eda973" returned: 0 in 0.266s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:13 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fe0b64d7-6696-4a0f-8d5b-f475b62a2e47 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-0f594a7d-0011-4df1-a26d-db7313eda973" released by "_delete_snapshot" :: held 1.981s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:13 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fe0b64d7-6696-4a0f-8d5b-f475b62a2e47 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-685f0f12-ded4-4ca7-8ea9-197c1451448c" released by "delete_snapshot" :: held 2.018s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:13 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-fe0b64d7-6696-4a0f-8d5b-f475b62a2e47 tempest-ProjectReaderTests-2080899454 None] Created reservations ['25818082-de2c-4e53-8e39-4cac4fbc7689', '76350883-7eb7-4a94-bfcb-44ea23827fab', '39a13769-9ae9-4189-9080-8d219f79b1df', '9ca5fc43-0d11-4192-9913-06fbe205926f'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:13 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-fe0b64d7-6696-4a0f-8d5b-f475b62a2e47 tempest-ProjectReaderTests-2080899454 None] Delete snapshot completed successfully. Sep 25 17:25:13 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-fe0b64d7-6696-4a0f-8d5b-f475b62a2e47 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-0f594a7d-0011-4df1-a26d-db7313eda973-delete_snapshot" released by "delete_snapshot" :: held 2.187s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-89f68fc9-5113-474f-9642-9760d92a7a28 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-89f68fc9-5113-474f-9642-9760d92a7a28 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:14 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-89f68fc9-5113-474f-9642-9760d92a7a28 tempest-ProjectMemberTests-1497756053 None] Creating offline snapshot abd37c75-d05c-47b1-9be5-f7374899de31 of volume afb155c3-aa94-47b3-9f26-71a9563bb7be {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:25:14 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acf9bdf-4768-408d-a0d2-e15d5c78105f]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-89f68fc9-5113-474f-9642-9760d92a7a28 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:14 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be Sep 25 17:25:14 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:14 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-89f68fc9-5113-474f-9642-9760d92a7a28 tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be" returned: 0 in 0.426s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-89f68fc9-5113-474f-9642-9760d92a7a28 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.abd37c75-d05c-47b1-9be5-f7374899de31 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:14 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.abd37c75-d05c-47b1-9be5-f7374899de31 1G Sep 25 17:25:14 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:14 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2514afb3-c4f8-4025-b3d4-9086130c85ca tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-685f0f12-ded4-4ca7-8ea9-197c1451448c-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:14 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2514afb3-c4f8-4025-b3d4-9086130c85ca tempest-ProjectReaderTests-2080899454 None] Lock "cinder-685f0f12-ded4-4ca7-8ea9-197c1451448c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:14 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2514afb3-c4f8-4025-b3d4-9086130c85ca tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-quobyte-685f0f12-ded4-4ca7-8ea9-197c1451448c" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:14 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2514afb3-c4f8-4025-b3d4-9086130c85ca tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-685f0f12-ded4-4ca7-8ea9-197c1451448c" acquired by "delete_volume" :: waited 0.024s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:14 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[353d8ee4-ea74-4fc4-83e6-88b72b4e579f]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:14 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2514afb3-c4f8-4025-b3d4-9086130c85ca tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:15 devstack sudo[108981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c Sep 25 17:25:15 devstack sudo[108981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:15 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-89f68fc9-5113-474f-9642-9760d92a7a28 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.abd37c75-d05c-47b1-9be5-f7374899de31 1G" returned: 0 in 0.559s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-89f68fc9-5113-474f-9642-9760d92a7a28 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afb155c3-aa94-47b3-9f26-71a9563bb7be -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.abd37c75-d05c-47b1-9be5-f7374899de31 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:15 devstack sudo[108985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afb155c3-aa94-47b3-9f26-71a9563bb7be -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.abd37c75-d05c-47b1-9be5-f7374899de31 Sep 25 17:25:15 devstack sudo[108985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:15 devstack sudo[108981]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2514afb3-c4f8-4025-b3d4-9086130c85ca tempest-ProjectReaderTests-2080899454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c" returned: 0 in 0.466s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2514afb3-c4f8-4025-b3d4-9086130c85ca tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:15 devstack sudo[108990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c Sep 25 17:25:15 devstack sudo[108990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:15 devstack sudo[108985]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-89f68fc9-5113-474f-9642-9760d92a7a28 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afb155c3-aa94-47b3-9f26-71a9563bb7be -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.abd37c75-d05c-47b1-9be5-f7374899de31" returned: 0 in 0.354s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:15 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-89f68fc9-5113-474f-9642-9760d92a7a28 tempest-ProjectMemberTests-1497756053 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.abd37c75-d05c-47b1-9be5-f7374899de31 is being set with open permissions: ugo+rw Sep 25 17:25:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-89f68fc9-5113-474f-9642-9760d92a7a28 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.abd37c75-d05c-47b1-9be5-f7374899de31 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:15 devstack sudo[108995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.abd37c75-d05c-47b1-9be5-f7374899de31 Sep 25 17:25:15 devstack sudo[108995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:15 devstack sudo[108990]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2514afb3-c4f8-4025-b3d4-9086130c85ca tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-685f0f12-ded4-4ca7-8ea9-197c1451448c" returned: 0 in 0.312s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:15 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2514afb3-c4f8-4025-b3d4-9086130c85ca tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-685f0f12-ded4-4ca7-8ea9-197c1451448c" released by "delete_volume" :: held 0.883s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:15 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-2514afb3-c4f8-4025-b3d4-9086130c85ca tempest-ProjectReaderTests-2080899454 None] Created reservations ['e8cb4e6e-260f-449a-8240-674a37c57b1b', 'a94c80ce-8f00-4333-92e9-8f9c91e867b9', 'ddf330f7-b00b-401f-9356-53804d1fd0af', 'f97c3915-3bb5-459b-aedc-76d4fa746575'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:15 devstack sudo[108995]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-89f68fc9-5113-474f-9642-9760d92a7a28 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.abd37c75-d05c-47b1-9be5-f7374899de31" returned: 0 in 0.273s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:15 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-89f68fc9-5113-474f-9642-9760d92a7a28 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:15 devstack sudo[108999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.info Sep 25 17:25:15 devstack sudo[108999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2514afb3-c4f8-4025-b3d4-9086130c85ca tempest-ProjectReaderTests-2080899454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2514afb3-c4f8-4025-b3d4-9086130c85ca tempest-ProjectReaderTests-2080899454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-2514afb3-c4f8-4025-b3d4-9086130c85ca tempest-ProjectReaderTests-2080899454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-2514afb3-c4f8-4025-b3d4-9086130c85ca tempest-ProjectReaderTests-2080899454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2514afb3-c4f8-4025-b3d4-9086130c85ca tempest-ProjectReaderTests-2080899454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2514afb3-c4f8-4025-b3d4-9086130c85ca tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:16 devstack sudo[109001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:25:16 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:16 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2514afb3-c4f8-4025-b3d4-9086130c85ca tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.315s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-2514afb3-c4f8-4025-b3d4-9086130c85ca tempest-ProjectReaderTests-2080899454 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:16 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-2514afb3-c4f8-4025-b3d4-9086130c85ca tempest-ProjectReaderTests-2080899454 None] Deleted volume successfully. Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2514afb3-c4f8-4025-b3d4-9086130c85ca tempest-ProjectReaderTests-2080899454 None] Lock "cinder-685f0f12-ded4-4ca7-8ea9-197c1451448c-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:16 devstack sudo[108999]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-89f68fc9-5113-474f-9642-9760d92a7a28 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.info" returned: 0 in 0.535s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:16 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-89f68fc9-5113-474f-9642-9760d92a7a28 tempest-ProjectMemberTests-1497756053 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.info is being set with open permissions: ugo+rw Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-89f68fc9-5113-474f-9642-9760d92a7a28 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:16 devstack sudo[109005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.info Sep 25 17:25:16 devstack sudo[109005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Flow 'volume_create_manager' (70380784-473f-4489-9265-581b74999390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5b52f9-c581-402b-9049-1914ee4f8207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5b52f9-c581-402b-9049-1914ee4f8207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429802519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483a477f-f358-4986-8da4-93b298707c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784ceac0fab64f9f842e927c40dac06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:17Z,use_quota=True,user_id='d52e638f870c40eeafb960bab0a3c015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9caca02c-97d8-45fc-b7a9-aa693049b0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9caca02c-97d8-45fc-b7a9-aa693049b0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80992008-abe7-405b-a53d-7fd82198b514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80992008-abe7-405b-a53d-7fd82198b514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '483a477f-f358-4986-8da4-93b298707c39', 'volume_name': 'volume-483a477f-f358-4986-8da4-93b298707c39', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766df59d-ee90-4557-a2cb-65d6794ba502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766df59d-ee90-4557-a2cb-65d6794ba502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df7b972-16b6-4ef7-82c5-83695bad1490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:16 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Volume 483a477f-f358-4986-8da4-93b298707c39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-483a477f-f358-4986-8da4-93b298707c39', 'volume_size': 1} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:16 devstack sudo[109005]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-89f68fc9-5113-474f-9642-9760d92a7a28 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.info" returned: 0 in 0.272s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-89f68fc9-5113-474f-9642-9760d92a7a28 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.536s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.093s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429802519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483a477f-f358-4986-8da4-93b298707c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784ceac0fab64f9f842e927c40dac06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:17Z,use_quota=True,user_id='d52e638f870c40eeafb960bab0a3c015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Creating volume 483a477f-f358-4986-8da4-93b298707c39 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:16 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:25:16 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:16 devstack sudo[109008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39 1073741824 Sep 25 17:25:16 devstack sudo[109008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:16 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-89f68fc9-5113-474f-9642-9760d92a7a28 tempest-ProjectMemberTests-1497756053 None] Create snapshot completed successfully Sep 25 17:25:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3184db7b-8122-49d6-983d-ab9d3a6a0f60 tempest-ProjectAdminTests-1370428538 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.299087524414, 'free_capacity_gb': 1775.299087524414, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87211) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 17:25:17 devstack sudo[109008]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39 1073741824" returned: 0 in 0.539s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:17 devstack sudo[109014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39 Sep 25 17:25:17 devstack sudo[109014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d44f645e-941a-4d07-9f7b-abb6782cea1b tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-abd37c75-d05c-47b1-9be5-f7374899de31-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d44f645e-941a-4d07-9f7b-abb6782cea1b tempest-ProjectMemberTests-1497756053 None] Lock "cinder-abd37c75-d05c-47b1-9be5-f7374899de31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d44f645e-941a-4d07-9f7b-abb6782cea1b tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-afb155c3-aa94-47b3-9f26-71a9563bb7be" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d44f645e-941a-4d07-9f7b-abb6782cea1b tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-afb155c3-aa94-47b3-9f26-71a9563bb7be" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d44f645e-941a-4d07-9f7b-abb6782cea1b tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-abd37c75-d05c-47b1-9be5-f7374899de31" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:17 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d44f645e-941a-4d07-9f7b-abb6782cea1b tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-abd37c75-d05c-47b1-9be5-f7374899de31" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-d44f645e-941a-4d07-9f7b-abb6782cea1b tempest-ProjectMemberTests-1497756053 None] Deleting offline snapshot abd37c75-d05c-47b1-9be5-f7374899de31 of volume afb155c3-aa94-47b3-9f26-71a9563bb7be {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:25:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-d44f645e-941a-4d07-9f7b-abb6782cea1b tempest-ProjectMemberTests-1497756053 None] snapshot_file for this snap is: volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.abd37c75-d05c-47b1-9be5-f7374899de31 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:25:17 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0337d54-1147-4dda-b715-92da7594d868]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d44f645e-941a-4d07-9f7b-abb6782cea1b tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.abd37c75-d05c-47b1-9be5-f7374899de31 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:17 devstack sudo[109014]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39" returned: 0 in 0.318s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:17 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:17 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df7b972-16b6-4ef7-82c5-83695bad1490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-483a477f-f358-4986-8da4-93b298707c39', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6692b762-6294-4357-aa10-01673fbc96d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:17 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Volume volume-483a477f-f358-4986-8da4-93b298707c39 (483a477f-f358-4986-8da4-93b298707c39): created successfully Sep 25 17:25:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6692b762-6294-4357-aa10-01673fbc96d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:17 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Flow 'volume_create_manager' (70380784-473f-4489-9265-581b74999390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:17 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-6c67a42d-82d3-4f76-a117-cea94dfb9324 tempest-ProjectReaderTests-2080899454 None] Created volume successfully. Sep 25 17:25:17 devstack sudo[109018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.abd37c75-d05c-47b1-9be5-f7374899de31 Sep 25 17:25:17 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:18 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d44f645e-941a-4d07-9f7b-abb6782cea1b tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.abd37c75-d05c-47b1-9be5-f7374899de31" returned: 0 in 0.454s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:18 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-d44f645e-941a-4d07-9f7b-abb6782cea1b tempest-ProjectMemberTests-1497756053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afb155c3-aa94-47b3-9f26-71a9563bb7be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:25:18 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a03d763-d29a-49c8-9578-d526b858d3a9]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d44f645e-941a-4d07-9f7b-abb6782cea1b tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:18 devstack sudo[109023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be Sep 25 17:25:18 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:18 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d44f645e-941a-4d07-9f7b-abb6782cea1b tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be" returned: 0 in 0.476s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:18 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d44f645e-941a-4d07-9f7b-abb6782cea1b tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.abd37c75-d05c-47b1-9be5-f7374899de31 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:18 devstack sudo[109028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.abd37c75-d05c-47b1-9be5-f7374899de31 Sep 25 17:25:18 devstack sudo[109028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:19 devstack sudo[109028]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d44f645e-941a-4d07-9f7b-abb6782cea1b tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.abd37c75-d05c-47b1-9be5-f7374899de31" returned: 0 in 0.445s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d44f645e-941a-4d07-9f7b-abb6782cea1b tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.abd37c75-d05c-47b1-9be5-f7374899de31 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-45a9f7bd-7411-4a49-91af-af8a315e6799 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-45a9f7bd-7411-4a49-91af-af8a315e6799 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:19 devstack sudo[109033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.abd37c75-d05c-47b1-9be5-f7374899de31 Sep 25 17:25:19 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:19 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-45a9f7bd-7411-4a49-91af-af8a315e6799 tempest-ProjectReaderTests-2080899454 None] Creating offline snapshot a2b1768d-42d5-419f-b917-e288a7a71a60 of volume 483a477f-f358-4986-8da4-93b298707c39 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:25:19 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[3351ef03-3ac3-4b01-9b57-704d252865e6]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-45a9f7bd-7411-4a49-91af-af8a315e6799 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:19 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39 Sep 25 17:25:19 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:19 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d44f645e-941a-4d07-9f7b-abb6782cea1b tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be.abd37c75-d05c-47b1-9be5-f7374899de31" returned: 0 in 0.349s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d44f645e-941a-4d07-9f7b-abb6782cea1b tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-abd37c75-d05c-47b1-9be5-f7374899de31" released by "_delete_snapshot" :: held 1.872s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d44f645e-941a-4d07-9f7b-abb6782cea1b tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-afb155c3-aa94-47b3-9f26-71a9563bb7be" released by "delete_snapshot" :: held 1.901s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:19 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-d44f645e-941a-4d07-9f7b-abb6782cea1b tempest-ProjectMemberTests-1497756053 None] Created reservations ['17920e33-41bb-4c4b-aabf-e5417ab1f467', 'f8718251-c423-4a7f-b4e1-eaa632089f99', 'da943465-5e77-490e-a7dc-fa232df3afab', '92c06240-3687-4358-a2e3-8d081ea381d3'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:19 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-45a9f7bd-7411-4a49-91af-af8a315e6799 tempest-ProjectReaderTests-2080899454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39" returned: 0 in 0.448s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-45a9f7bd-7411-4a49-91af-af8a315e6799 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.a2b1768d-42d5-419f-b917-e288a7a71a60 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:19 devstack sudo[109042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.a2b1768d-42d5-419f-b917-e288a7a71a60 1G Sep 25 17:25:19 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:19 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-d44f645e-941a-4d07-9f7b-abb6782cea1b tempest-ProjectMemberTests-1497756053 None] Delete snapshot completed successfully. Sep 25 17:25:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d44f645e-941a-4d07-9f7b-abb6782cea1b tempest-ProjectMemberTests-1497756053 None] Lock "cinder-abd37c75-d05c-47b1-9be5-f7374899de31-delete_snapshot" released by "delete_snapshot" :: held 2.166s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-14f9ec72-313d-4348-8fdc-bcf7c4b8b59d tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-afb155c3-aa94-47b3-9f26-71a9563bb7be-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-14f9ec72-313d-4348-8fdc-bcf7c4b8b59d tempest-ProjectMemberTests-1497756053 None] Lock "cinder-afb155c3-aa94-47b3-9f26-71a9563bb7be-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-14f9ec72-313d-4348-8fdc-bcf7c4b8b59d tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-afb155c3-aa94-47b3-9f26-71a9563bb7be" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:19 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-14f9ec72-313d-4348-8fdc-bcf7c4b8b59d tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-afb155c3-aa94-47b3-9f26-71a9563bb7be" acquired by "delete_volume" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:19 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a3eff6-7430-4f61-a42d-06767dedd063]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:19 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-14f9ec72-313d-4348-8fdc-bcf7c4b8b59d tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:19 devstack sudo[109044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be Sep 25 17:25:19 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:20 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-45a9f7bd-7411-4a49-91af-af8a315e6799 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.a2b1768d-42d5-419f-b917-e288a7a71a60 1G" returned: 0 in 0.528s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-45a9f7bd-7411-4a49-91af-af8a315e6799 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-483a477f-f358-4986-8da4-93b298707c39 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.a2b1768d-42d5-419f-b917-e288a7a71a60 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:20 devstack sudo[109049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-483a477f-f358-4986-8da4-93b298707c39 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.a2b1768d-42d5-419f-b917-e288a7a71a60 Sep 25 17:25:20 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:20 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-14f9ec72-313d-4348-8fdc-bcf7c4b8b59d tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be" returned: 0 in 0.485s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-14f9ec72-313d-4348-8fdc-bcf7c4b8b59d tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:20 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be Sep 25 17:25:20 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:20 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-45a9f7bd-7411-4a49-91af-af8a315e6799 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-483a477f-f358-4986-8da4-93b298707c39 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.a2b1768d-42d5-419f-b917-e288a7a71a60" returned: 0 in 0.345s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:20 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-45a9f7bd-7411-4a49-91af-af8a315e6799 tempest-ProjectReaderTests-2080899454 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.a2b1768d-42d5-419f-b917-e288a7a71a60 is being set with open permissions: ugo+rw Sep 25 17:25:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-45a9f7bd-7411-4a49-91af-af8a315e6799 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.a2b1768d-42d5-419f-b917-e288a7a71a60 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:20 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.a2b1768d-42d5-419f-b917-e288a7a71a60 Sep 25 17:25:20 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:20 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-14f9ec72-313d-4348-8fdc-bcf7c4b8b59d tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-afb155c3-aa94-47b3-9f26-71a9563bb7be" returned: 0 in 0.319s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:20 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-14f9ec72-313d-4348-8fdc-bcf7c4b8b59d tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-afb155c3-aa94-47b3-9f26-71a9563bb7be" released by "delete_volume" :: held 0.902s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:20 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-14f9ec72-313d-4348-8fdc-bcf7c4b8b59d tempest-ProjectMemberTests-1497756053 None] Created reservations ['daec5566-8d17-4452-b497-863cec18829b', '4c666ac2-bb9c-436d-b89e-aba50d5b697b', '6188e76e-9241-4523-b93f-78c2d846c888', '64e9a3ca-1842-4ce9-8c69-8fa5ff05044f'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:20 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-45a9f7bd-7411-4a49-91af-af8a315e6799 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.a2b1768d-42d5-419f-b917-e288a7a71a60" returned: 0 in 0.282s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-45a9f7bd-7411-4a49-91af-af8a315e6799 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:20 devstack sudo[109064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.info Sep 25 17:25:20 devstack sudo[109064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-14f9ec72-313d-4348-8fdc-bcf7c4b8b59d tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-14f9ec72-313d-4348-8fdc-bcf7c4b8b59d tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:20 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-14f9ec72-313d-4348-8fdc-bcf7c4b8b59d tempest-ProjectMemberTests-1497756053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:20 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-14f9ec72-313d-4348-8fdc-bcf7c4b8b59d tempest-ProjectMemberTests-1497756053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-14f9ec72-313d-4348-8fdc-bcf7c4b8b59d tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:20 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-14f9ec72-313d-4348-8fdc-bcf7c4b8b59d tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:20 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:25:20 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:21 devstack sudo[109064]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-45a9f7bd-7411-4a49-91af-af8a315e6799 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.info" returned: 0 in 0.394s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:21 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-45a9f7bd-7411-4a49-91af-af8a315e6799 tempest-ProjectReaderTests-2080899454 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.info is being set with open permissions: ugo+rw Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-45a9f7bd-7411-4a49-91af-af8a315e6799 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:21 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-14f9ec72-313d-4348-8fdc-bcf7c4b8b59d tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.337s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-14f9ec72-313d-4348-8fdc-bcf7c4b8b59d tempest-ProjectMemberTests-1497756053 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:21 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-14f9ec72-313d-4348-8fdc-bcf7c4b8b59d tempest-ProjectMemberTests-1497756053 None] Deleted volume successfully. Sep 25 17:25:21 devstack sudo[109070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.info Sep 25 17:25:21 devstack sudo[109070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-14f9ec72-313d-4348-8fdc-bcf7c4b8b59d tempest-ProjectMemberTests-1497756053 None] Lock "cinder-afb155c3-aa94-47b3-9f26-71a9563bb7be-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:21 devstack sudo[109070]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Flow 'volume_create_manager' (3cefabb2-776a-475b-895b-98e46cea3a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c770db84-6970-44fe-91d9-564f67b87760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-45a9f7bd-7411-4a49-91af-af8a315e6799 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.info" returned: 0 in 0.345s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-45a9f7bd-7411-4a49-91af-af8a315e6799 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.484s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c770db84-6970-44fe-91d9-564f67b87760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-312354100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a53e0c53-a3d0-4583-b261-39e623ace32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31fdfb42d1d48219cd53e16d4a0131f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:21Z,use_quota=True,user_id='645f5007ad61465e9de1ac84410dacf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b58cddc6-c920-428e-9bfd-119cc9be9be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b58cddc6-c920-428e-9bfd-119cc9be9be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2803e34-fde1-44a2-960d-d85a9ee3d132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2803e34-fde1-44a2-960d-d85a9ee3d132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a53e0c53-a3d0-4583-b261-39e623ace32d', 'volume_name': 'volume-a53e0c53-a3d0-4583-b261-39e623ace32d', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a401302-0157-40bd-98a8-abcd482f362a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a401302-0157-40bd-98a8-abcd482f362a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b82b092-3973-4790-9017-93359656df07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:21 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Volume a53e0c53-a3d0-4583-b261-39e623ace32d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a53e0c53-a3d0-4583-b261-39e623ace32d', 'volume_size': 1} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-312354100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a53e0c53-a3d0-4583-b261-39e623ace32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31fdfb42d1d48219cd53e16d4a0131f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:21Z,use_quota=True,user_id='645f5007ad61465e9de1ac84410dacf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Creating volume a53e0c53-a3d0-4583-b261-39e623ace32d {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:21 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:25:21 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:21 devstack sudo[109073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d 1073741824 Sep 25 17:25:21 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:21 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-45a9f7bd-7411-4a49-91af-af8a315e6799 tempest-ProjectReaderTests-2080899454 None] Create snapshot completed successfully Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-494b6d1d-3fed-4e05-99f2-52f6e826c3a7 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-a2b1768d-42d5-419f-b917-e288a7a71a60-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-494b6d1d-3fed-4e05-99f2-52f6e826c3a7 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-a2b1768d-42d5-419f-b917-e288a7a71a60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:22 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-494b6d1d-3fed-4e05-99f2-52f6e826c3a7 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-quobyte-483a477f-f358-4986-8da4-93b298707c39" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d 1073741824" returned: 0 in 0.573s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-494b6d1d-3fed-4e05-99f2-52f6e826c3a7 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-483a477f-f358-4986-8da4-93b298707c39" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-494b6d1d-3fed-4e05-99f2-52f6e826c3a7 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-quobyte-a2b1768d-42d5-419f-b917-e288a7a71a60" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-494b6d1d-3fed-4e05-99f2-52f6e826c3a7 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-a2b1768d-42d5-419f-b917-e288a7a71a60" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-494b6d1d-3fed-4e05-99f2-52f6e826c3a7 tempest-ProjectReaderTests-2080899454 None] Deleting offline snapshot a2b1768d-42d5-419f-b917-e288a7a71a60 of volume 483a477f-f358-4986-8da4-93b298707c39 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-494b6d1d-3fed-4e05-99f2-52f6e826c3a7 tempest-ProjectReaderTests-2080899454 None] snapshot_file for this snap is: volume-483a477f-f358-4986-8da4-93b298707c39.a2b1768d-42d5-419f-b917-e288a7a71a60 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0dd23a-b040-4e59-b048-45c7a6900376]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-494b6d1d-3fed-4e05-99f2-52f6e826c3a7 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.a2b1768d-42d5-419f-b917-e288a7a71a60 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:22 devstack sudo[109079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d Sep 25 17:25:22 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:22 devstack sudo[109080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.a2b1768d-42d5-419f-b917-e288a7a71a60 Sep 25 17:25:22 devstack sudo[109080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:22 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d" returned: 0 in 0.274s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b82b092-3973-4790-9017-93359656df07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a53e0c53-a3d0-4583-b261-39e623ace32d', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0746b55-1495-4958-9b8b-78107a32ca92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:22 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Volume volume-a53e0c53-a3d0-4583-b261-39e623ace32d (a53e0c53-a3d0-4583-b261-39e623ace32d): created successfully Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0746b55-1495-4958-9b8b-78107a32ca92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Flow 'volume_create_manager' (3cefabb2-776a-475b-895b-98e46cea3a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:22 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-3cb55b49-9270-4fc0-a2db-f640109bbc28 tempest-ProjectMemberTests-1497756053 None] Created volume successfully. Sep 25 17:25:22 devstack sudo[109080]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-494b6d1d-3fed-4e05-99f2-52f6e826c3a7 tempest-ProjectReaderTests-2080899454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.a2b1768d-42d5-419f-b917-e288a7a71a60" returned: 0 in 0.463s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-494b6d1d-3fed-4e05-99f2-52f6e826c3a7 tempest-ProjectReaderTests-2080899454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-483a477f-f358-4986-8da4-93b298707c39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1726156-d363-478f-b6ed-1dd65c350185]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:22 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-494b6d1d-3fed-4e05-99f2-52f6e826c3a7 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:22 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39 Sep 25 17:25:22 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:23 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-494b6d1d-3fed-4e05-99f2-52f6e826c3a7 tempest-ProjectReaderTests-2080899454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39" returned: 0 in 0.477s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-494b6d1d-3fed-4e05-99f2-52f6e826c3a7 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.a2b1768d-42d5-419f-b917-e288a7a71a60 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:23 devstack sudo[109093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.a2b1768d-42d5-419f-b917-e288a7a71a60 Sep 25 17:25:23 devstack sudo[109093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:23 devstack sudo[109093]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-494b6d1d-3fed-4e05-99f2-52f6e826c3a7 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.a2b1768d-42d5-419f-b917-e288a7a71a60" returned: 0 in 0.454s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-494b6d1d-3fed-4e05-99f2-52f6e826c3a7 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.a2b1768d-42d5-419f-b917-e288a7a71a60 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:23 devstack sudo[109099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.a2b1768d-42d5-419f-b917-e288a7a71a60 Sep 25 17:25:23 devstack sudo[109099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a40d4136-8b91-49e8-bf95-c25c832ad3cb tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a40d4136-8b91-49e8-bf95-c25c832ad3cb tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:23 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-a40d4136-8b91-49e8-bf95-c25c832ad3cb tempest-ProjectMemberTests-1497756053 None] Creating offline snapshot d835a455-a0ab-4365-b38e-44115110b606 of volume a53e0c53-a3d0-4583-b261-39e623ace32d {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:25:23 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[06529d62-4583-421a-8b4c-d3825f01e00e]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:23 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a40d4136-8b91-49e8-bf95-c25c832ad3cb tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:24 devstack sudo[109099]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-494b6d1d-3fed-4e05-99f2-52f6e826c3a7 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39.a2b1768d-42d5-419f-b917-e288a7a71a60" returned: 0 in 0.306s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:24 devstack sudo[109101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d Sep 25 17:25:24 devstack sudo[109101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-494b6d1d-3fed-4e05-99f2-52f6e826c3a7 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-a2b1768d-42d5-419f-b917-e288a7a71a60" released by "_delete_snapshot" :: held 1.869s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-494b6d1d-3fed-4e05-99f2-52f6e826c3a7 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-483a477f-f358-4986-8da4-93b298707c39" released by "delete_snapshot" :: held 1.905s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:24 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-494b6d1d-3fed-4e05-99f2-52f6e826c3a7 tempest-ProjectReaderTests-2080899454 None] Created reservations ['3372c529-0535-411a-ab7e-4f978a84b1c3', 'd3fafefa-ea4c-41f2-b49d-d0cda20a4cb8', 'e43e51df-6542-451d-8bc9-a13452f1249b', '88f81633-dbf9-45c9-be17-af4f4f5a4ff5'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:24 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-494b6d1d-3fed-4e05-99f2-52f6e826c3a7 tempest-ProjectReaderTests-2080899454 None] Delete snapshot completed successfully. Sep 25 17:25:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-494b6d1d-3fed-4e05-99f2-52f6e826c3a7 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-a2b1768d-42d5-419f-b917-e288a7a71a60-delete_snapshot" released by "delete_snapshot" :: held 2.127s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2f9f1c1e-eac0-4955-a023-97a46ae1e027 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-483a477f-f358-4986-8da4-93b298707c39-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2f9f1c1e-eac0-4955-a023-97a46ae1e027 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-483a477f-f358-4986-8da4-93b298707c39-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:24 devstack sudo[109101]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a40d4136-8b91-49e8-bf95-c25c832ad3cb tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d" returned: 0 in 0.538s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a40d4136-8b91-49e8-bf95-c25c832ad3cb tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.d835a455-a0ab-4365-b38e-44115110b606 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:24 devstack sudo[109107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.d835a455-a0ab-4365-b38e-44115110b606 1G Sep 25 17:25:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2f9f1c1e-eac0-4955-a023-97a46ae1e027 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-quobyte-483a477f-f358-4986-8da4-93b298707c39" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:24 devstack sudo[109107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:24 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2f9f1c1e-eac0-4955-a023-97a46ae1e027 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-483a477f-f358-4986-8da4-93b298707c39" acquired by "delete_volume" :: waited 0.025s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:24 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b938e8ef-43a8-431e-b1db-7dde179d0034]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:24 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2f9f1c1e-eac0-4955-a023-97a46ae1e027 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:24 devstack sudo[109109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39 Sep 25 17:25:24 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:25 devstack sudo[109107]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:25 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a40d4136-8b91-49e8-bf95-c25c832ad3cb tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.d835a455-a0ab-4365-b38e-44115110b606 1G" returned: 0 in 0.597s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a40d4136-8b91-49e8-bf95-c25c832ad3cb tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a53e0c53-a3d0-4583-b261-39e623ace32d -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.d835a455-a0ab-4365-b38e-44115110b606 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2f9f1c1e-eac0-4955-a023-97a46ae1e027 tempest-ProjectReaderTests-2080899454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39" returned: 0 in 0.492s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2f9f1c1e-eac0-4955-a023-97a46ae1e027 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:25 devstack sudo[109117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a53e0c53-a3d0-4583-b261-39e623ace32d -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.d835a455-a0ab-4365-b38e-44115110b606 Sep 25 17:25:25 devstack sudo[109117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:25 devstack sudo[109118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39 Sep 25 17:25:25 devstack sudo[109118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:25 devstack sudo[109118]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2f9f1c1e-eac0-4955-a023-97a46ae1e027 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-483a477f-f358-4986-8da4-93b298707c39" returned: 0 in 0.309s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2f9f1c1e-eac0-4955-a023-97a46ae1e027 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-483a477f-f358-4986-8da4-93b298707c39" released by "delete_volume" :: held 0.884s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:25 devstack sudo[109117]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a40d4136-8b91-49e8-bf95-c25c832ad3cb tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a53e0c53-a3d0-4583-b261-39e623ace32d -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.d835a455-a0ab-4365-b38e-44115110b606" returned: 0 in 0.397s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:25 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-a40d4136-8b91-49e8-bf95-c25c832ad3cb tempest-ProjectMemberTests-1497756053 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.d835a455-a0ab-4365-b38e-44115110b606 is being set with open permissions: ugo+rw Sep 25 17:25:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a40d4136-8b91-49e8-bf95-c25c832ad3cb tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.d835a455-a0ab-4365-b38e-44115110b606 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:25 devstack sudo[109125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.d835a455-a0ab-4365-b38e-44115110b606 Sep 25 17:25:25 devstack sudo[109125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:25 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-2f9f1c1e-eac0-4955-a023-97a46ae1e027 tempest-ProjectReaderTests-2080899454 None] Created reservations ['aceeb893-207b-4f5a-96de-b0fe5577262a', 'c85bf732-8071-4f9b-a3c8-bbe291a602cc', 'c49b8d55-c5c3-40f4-a2d5-9d3802d651b9', '9ef595b5-484d-479f-8934-b512d64fccdc'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2f9f1c1e-eac0-4955-a023-97a46ae1e027 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2f9f1c1e-eac0-4955-a023-97a46ae1e027 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:25 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-2f9f1c1e-eac0-4955-a023-97a46ae1e027 tempest-ProjectReaderTests-2080899454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:25 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-2f9f1c1e-eac0-4955-a023-97a46ae1e027 tempest-ProjectReaderTests-2080899454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-2f9f1c1e-eac0-4955-a023-97a46ae1e027 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2f9f1c1e-eac0-4955-a023-97a46ae1e027 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:25 devstack sudo[109127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:25:25 devstack sudo[109127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:25 devstack sudo[109125]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a40d4136-8b91-49e8-bf95-c25c832ad3cb tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.d835a455-a0ab-4365-b38e-44115110b606" returned: 0 in 0.337s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a40d4136-8b91-49e8-bf95-c25c832ad3cb tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:25 devstack sudo[109127]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:25 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-2f9f1c1e-eac0-4955-a023-97a46ae1e027 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.308s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:25 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-2f9f1c1e-eac0-4955-a023-97a46ae1e027 tempest-ProjectReaderTests-2080899454 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:25 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.info Sep 25 17:25:25 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:25 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-2f9f1c1e-eac0-4955-a023-97a46ae1e027 tempest-ProjectReaderTests-2080899454 None] Deleted volume successfully. Sep 25 17:25:25 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-2f9f1c1e-eac0-4955-a023-97a46ae1e027 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-483a477f-f358-4986-8da4-93b298707c39-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:26 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a40d4136-8b91-49e8-bf95-c25c832ad3cb tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.info" returned: 0 in 0.330s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:26 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-a40d4136-8b91-49e8-bf95-c25c832ad3cb tempest-ProjectMemberTests-1497756053 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.info is being set with open permissions: ugo+rw Sep 25 17:25:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a40d4136-8b91-49e8-bf95-c25c832ad3cb tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:26 devstack sudo[109134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.info Sep 25 17:25:26 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:26 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a40d4136-8b91-49e8-bf95-c25c832ad3cb tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.info" returned: 0 in 0.253s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:26 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a40d4136-8b91-49e8-bf95-c25c832ad3cb tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.603s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:26 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-a40d4136-8b91-49e8-bf95-c25c832ad3cb tempest-ProjectMemberTests-1497756053 None] Create snapshot completed successfully Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7792c0b7-3315-48c4-936d-0914640d458b tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-d835a455-a0ab-4365-b38e-44115110b606-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7792c0b7-3315-48c4-936d-0914640d458b tempest-ProjectMemberTests-1497756053 None] Lock "cinder-d835a455-a0ab-4365-b38e-44115110b606-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7792c0b7-3315-48c4-936d-0914640d458b tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-a53e0c53-a3d0-4583-b261-39e623ace32d" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7792c0b7-3315-48c4-936d-0914640d458b tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-a53e0c53-a3d0-4583-b261-39e623ace32d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7792c0b7-3315-48c4-936d-0914640d458b tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-d835a455-a0ab-4365-b38e-44115110b606" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7792c0b7-3315-48c4-936d-0914640d458b tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-d835a455-a0ab-4365-b38e-44115110b606" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-7792c0b7-3315-48c4-936d-0914640d458b tempest-ProjectMemberTests-1497756053 None] Deleting offline snapshot d835a455-a0ab-4365-b38e-44115110b606 of volume a53e0c53-a3d0-4583-b261-39e623ace32d {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-7792c0b7-3315-48c4-936d-0914640d458b tempest-ProjectMemberTests-1497756053 None] snapshot_file for this snap is: volume-a53e0c53-a3d0-4583-b261-39e623ace32d.d835a455-a0ab-4365-b38e-44115110b606 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[273d189a-59af-4e5c-9acd-083a0127b67c]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7792c0b7-3315-48c4-936d-0914640d458b tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.d835a455-a0ab-4365-b38e-44115110b606 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:27 devstack sudo[109138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.d835a455-a0ab-4365-b38e-44115110b606 Sep 25 17:25:27 devstack sudo[109138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Flow 'volume_create_manager' (8d94098a-eb47-427f-b734-b87d9204ea1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52274b93-8ccc-480c-9a29-2c642ad6f93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52274b93-8ccc-480c-9a29-2c642ad6f93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1552862399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d101d00-fe5f-4f8e-a08c-829aa804465a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784ceac0fab64f9f842e927c40dac06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:27Z,use_quota=True,user_id='d52e638f870c40eeafb960bab0a3c015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21efdada-2a18-4b43-babd-b23112012a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21efdada-2a18-4b43-babd-b23112012a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecdb0d30-926e-4a0c-be7d-a782bf1c645e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecdb0d30-926e-4a0c-be7d-a782bf1c645e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d101d00-fe5f-4f8e-a08c-829aa804465a', 'volume_name': 'volume-6d101d00-fe5f-4f8e-a08c-829aa804465a', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c77561e-f612-4d86-adc3-b10481b38572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c77561e-f612-4d86-adc3-b10481b38572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d4f13b-37b0-499f-9d96-a1bfc0292e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:27 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Volume 6d101d00-fe5f-4f8e-a08c-829aa804465a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d101d00-fe5f-4f8e-a08c-829aa804465a', 'volume_size': 1} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1552862399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d101d00-fe5f-4f8e-a08c-829aa804465a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784ceac0fab64f9f842e927c40dac06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:27Z,use_quota=True,user_id='d52e638f870c40eeafb960bab0a3c015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Creating volume 6d101d00-fe5f-4f8e-a08c-829aa804465a {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:27 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:27 devstack sudo[109147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a 1073741824 Sep 25 17:25:27 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:27 devstack sudo[109138]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7792c0b7-3315-48c4-936d-0914640d458b tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.d835a455-a0ab-4365-b38e-44115110b606" returned: 0 in 0.397s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-7792c0b7-3315-48c4-936d-0914640d458b tempest-ProjectMemberTests-1497756053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a53e0c53-a3d0-4583-b261-39e623ace32d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ccf0c0-2074-4fb9-aae4-30acee4c61f6]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:27 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7792c0b7-3315-48c4-936d-0914640d458b tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:27 devstack sudo[109149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d Sep 25 17:25:27 devstack sudo[109149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:28 devstack sudo[109149]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7792c0b7-3315-48c4-936d-0914640d458b tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d" returned: 0 in 0.408s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7792c0b7-3315-48c4-936d-0914640d458b tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.d835a455-a0ab-4365-b38e-44115110b606 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:28 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a 1073741824" returned: 0 in 0.499s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:28 devstack sudo[109158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.d835a455-a0ab-4365-b38e-44115110b606 Sep 25 17:25:28 devstack sudo[109158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:28 devstack sudo[109160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a Sep 25 17:25:28 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:28 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a" returned: 0 in 0.269s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:28 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d4f13b-37b0-499f-9d96-a1bfc0292e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d101d00-fe5f-4f8e-a08c-829aa804465a', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a51935e-5035-4b18-b204-075666deb2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:28 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Volume volume-6d101d00-fe5f-4f8e-a08c-829aa804465a (6d101d00-fe5f-4f8e-a08c-829aa804465a): created successfully Sep 25 17:25:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a51935e-5035-4b18-b204-075666deb2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:28 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Flow 'volume_create_manager' (8d94098a-eb47-427f-b734-b87d9204ea1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:28 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-bd04cf16-e788-4c43-8ed0-5ad4ca1bf97a tempest-ProjectReaderTests-2080899454 None] Created volume successfully. Sep 25 17:25:28 devstack sudo[109158]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7792c0b7-3315-48c4-936d-0914640d458b tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.d835a455-a0ab-4365-b38e-44115110b606" returned: 0 in 0.441s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7792c0b7-3315-48c4-936d-0914640d458b tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.d835a455-a0ab-4365-b38e-44115110b606 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:28 devstack sudo[109166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.d835a455-a0ab-4365-b38e-44115110b606 Sep 25 17:25:28 devstack sudo[109166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:28 devstack sudo[109166]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:28 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-7792c0b7-3315-48c4-936d-0914640d458b tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d.d835a455-a0ab-4365-b38e-44115110b606" returned: 0 in 0.264s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7792c0b7-3315-48c4-936d-0914640d458b tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-d835a455-a0ab-4365-b38e-44115110b606" released by "_delete_snapshot" :: held 1.614s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7792c0b7-3315-48c4-936d-0914640d458b tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-a53e0c53-a3d0-4583-b261-39e623ace32d" released by "delete_snapshot" :: held 1.639s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:28 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-7792c0b7-3315-48c4-936d-0914640d458b tempest-ProjectMemberTests-1497756053 None] Created reservations ['c79a3e81-53d9-46ca-a8ac-f63f36daa8b4', 'd1e1415a-fdb1-4ced-bed1-30ebbf3c5a18', '2ded7a27-8b3d-49de-ae0a-e41f840db948', 'd22e7a1a-8410-4ef0-bcfe-06a81e61fcca'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:28 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-7792c0b7-3315-48c4-936d-0914640d458b tempest-ProjectMemberTests-1497756053 None] Delete snapshot completed successfully. Sep 25 17:25:28 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-7792c0b7-3315-48c4-936d-0914640d458b tempest-ProjectMemberTests-1497756053 None] Lock "cinder-d835a455-a0ab-4365-b38e-44115110b606-delete_snapshot" released by "delete_snapshot" :: held 1.796s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8767fc03-90ca-4483-90a2-ac6538e2b655 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-a53e0c53-a3d0-4583-b261-39e623ace32d-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8767fc03-90ca-4483-90a2-ac6538e2b655 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-a53e0c53-a3d0-4583-b261-39e623ace32d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8767fc03-90ca-4483-90a2-ac6538e2b655 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-a53e0c53-a3d0-4583-b261-39e623ace32d" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:29 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8767fc03-90ca-4483-90a2-ac6538e2b655 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-a53e0c53-a3d0-4583-b261-39e623ace32d" acquired by "delete_volume" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:29 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e190da-3d36-4ab1-9a54-1c99e8e74b60]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8767fc03-90ca-4483-90a2-ac6538e2b655 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-fde44ad2-6dc3-494f-a826-7f217caf4066 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-fde44ad2-6dc3-494f-a826-7f217caf4066 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:29 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-fde44ad2-6dc3-494f-a826-7f217caf4066 tempest-ProjectReaderTests-2080899454 None] Creating offline snapshot 4645d298-8ae1-4d18-a436-dbd606c3cd96 of volume 6d101d00-fe5f-4f8e-a08c-829aa804465a {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:25:29 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[174684d6-046e-44c6-b4a4-917b128ec08d]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fde44ad2-6dc3-494f-a826-7f217caf4066 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:29 devstack sudo[109169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d Sep 25 17:25:29 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:29 devstack sudo[109170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a Sep 25 17:25:29 devstack sudo[109170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:29 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8767fc03-90ca-4483-90a2-ac6538e2b655 tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d" returned: 0 in 0.396s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8767fc03-90ca-4483-90a2-ac6538e2b655 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:29 devstack sudo[109178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d Sep 25 17:25:29 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:29 devstack sudo[109170]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fde44ad2-6dc3-494f-a826-7f217caf4066 tempest-ProjectReaderTests-2080899454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a" returned: 0 in 0.376s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fde44ad2-6dc3-494f-a826-7f217caf4066 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.4645d298-8ae1-4d18-a436-dbd606c3cd96 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:29 devstack sudo[109182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.4645d298-8ae1-4d18-a436-dbd606c3cd96 1G Sep 25 17:25:29 devstack sudo[109182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:30 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8767fc03-90ca-4483-90a2-ac6538e2b655 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-a53e0c53-a3d0-4583-b261-39e623ace32d" returned: 0 in 0.274s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8767fc03-90ca-4483-90a2-ac6538e2b655 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-a53e0c53-a3d0-4583-b261-39e623ace32d" released by "delete_volume" :: held 0.767s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:30 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-8767fc03-90ca-4483-90a2-ac6538e2b655 tempest-ProjectMemberTests-1497756053 None] Created reservations ['4a96faed-d99a-4177-8527-991996526f2b', '7518478d-2f30-4da3-b57f-9131b20bbd79', '83416982-abfc-4a48-b52f-faf3bd104354', 'efb377b4-b58f-4005-b4bc-46a2c6768ab4'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8767fc03-90ca-4483-90a2-ac6538e2b655 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8767fc03-90ca-4483-90a2-ac6538e2b655 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8767fc03-90ca-4483-90a2-ac6538e2b655 tempest-ProjectMemberTests-1497756053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8767fc03-90ca-4483-90a2-ac6538e2b655 tempest-ProjectMemberTests-1497756053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8767fc03-90ca-4483-90a2-ac6538e2b655 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8767fc03-90ca-4483-90a2-ac6538e2b655 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:30 devstack sudo[109189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:25:30 devstack sudo[109189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:30 devstack sudo[109182]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fde44ad2-6dc3-494f-a826-7f217caf4066 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.4645d298-8ae1-4d18-a436-dbd606c3cd96 1G" returned: 0 in 0.495s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fde44ad2-6dc3-494f-a826-7f217caf4066 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d101d00-fe5f-4f8e-a08c-829aa804465a -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.4645d298-8ae1-4d18-a436-dbd606c3cd96 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:30 devstack sudo[109191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d101d00-fe5f-4f8e-a08c-829aa804465a -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.4645d298-8ae1-4d18-a436-dbd606c3cd96 Sep 25 17:25:30 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:30 devstack sudo[109189]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8767fc03-90ca-4483-90a2-ac6538e2b655 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.315s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:30 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-8767fc03-90ca-4483-90a2-ac6538e2b655 tempest-ProjectMemberTests-1497756053 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:30 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-8767fc03-90ca-4483-90a2-ac6538e2b655 tempest-ProjectMemberTests-1497756053 None] Deleted volume successfully. Sep 25 17:25:30 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-8767fc03-90ca-4483-90a2-ac6538e2b655 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-a53e0c53-a3d0-4583-b261-39e623ace32d-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:30 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fde44ad2-6dc3-494f-a826-7f217caf4066 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d101d00-fe5f-4f8e-a08c-829aa804465a -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.4645d298-8ae1-4d18-a436-dbd606c3cd96" returned: 0 in 0.379s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:30 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-fde44ad2-6dc3-494f-a826-7f217caf4066 tempest-ProjectReaderTests-2080899454 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.4645d298-8ae1-4d18-a436-dbd606c3cd96 is being set with open permissions: ugo+rw Sep 25 17:25:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fde44ad2-6dc3-494f-a826-7f217caf4066 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.4645d298-8ae1-4d18-a436-dbd606c3cd96 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:30 devstack sudo[109197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.4645d298-8ae1-4d18-a436-dbd606c3cd96 Sep 25 17:25:30 devstack sudo[109197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:31 devstack sudo[109197]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fde44ad2-6dc3-494f-a826-7f217caf4066 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.4645d298-8ae1-4d18-a436-dbd606c3cd96" returned: 0 in 0.323s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fde44ad2-6dc3-494f-a826-7f217caf4066 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:31 devstack sudo[109200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.info Sep 25 17:25:31 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Flow 'volume_create_manager' (af427f98-bf38-4b72-9bc5-b38f207dc214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ee6935-fb0e-45be-adf5-3930d906a21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ee6935-fb0e-45be-adf5-3930d906a21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1716584102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a15cc3-f697-43ef-a85b-082613f6935f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31fdfb42d1d48219cd53e16d4a0131f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:31Z,use_quota=True,user_id='645f5007ad61465e9de1ac84410dacf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b357e4-d2fd-4658-b21d-7e6dbd20397f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b357e4-d2fd-4658-b21d-7e6dbd20397f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71f3f9d-23ba-4453-8cba-1ea79f91ae41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71f3f9d-23ba-4453-8cba-1ea79f91ae41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31a15cc3-f697-43ef-a85b-082613f6935f', 'volume_name': 'volume-31a15cc3-f697-43ef-a85b-082613f6935f', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b2e87d-9394-40f9-8567-da0b103e4fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b2e87d-9394-40f9-8567-da0b103e4fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (482a20f6-c605-497c-8dab-191e3c28325e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:31 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Volume 31a15cc3-f697-43ef-a85b-082613f6935f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31a15cc3-f697-43ef-a85b-082613f6935f', 'volume_size': 1} Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:31 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fde44ad2-6dc3-494f-a826-7f217caf4066 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.info" returned: 0 in 0.275s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:31 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-fde44ad2-6dc3-494f-a826-7f217caf4066 tempest-ProjectReaderTests-2080899454 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.info is being set with open permissions: ugo+rw Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fde44ad2-6dc3-494f-a826-7f217caf4066 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:31 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.info Sep 25 17:25:31 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:31 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-fde44ad2-6dc3-494f-a826-7f217caf4066 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.info" returned: 0 in 0.241s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-fde44ad2-6dc3-494f-a826-7f217caf4066 tempest-ProjectReaderTests-2080899454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.281s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1716584102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a15cc3-f697-43ef-a85b-082613f6935f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31fdfb42d1d48219cd53e16d4a0131f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:31Z,use_quota=True,user_id='645f5007ad61465e9de1ac84410dacf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Creating volume 31a15cc3-f697-43ef-a85b-082613f6935f {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:31 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:25:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:31 devstack sudo[109206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f 1073741824 Sep 25 17:25:31 devstack sudo[109206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:31 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-fde44ad2-6dc3-494f-a826-7f217caf4066 tempest-ProjectReaderTests-2080899454 None] Create snapshot completed successfully Sep 25 17:25:32 devstack sudo[109206]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f 1073741824" returned: 0 in 0.443s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:32 devstack sudo[109212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f Sep 25 17:25:32 devstack sudo[109212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:32 devstack sudo[109212]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f" returned: 0 in 0.265s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (482a20f6-c605-497c-8dab-191e3c28325e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31a15cc3-f697-43ef-a85b-082613f6935f', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5e9241-1183-42c0-a5d7-c546f8bdb810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:32 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Volume volume-31a15cc3-f697-43ef-a85b-082613f6935f (31a15cc3-f697-43ef-a85b-082613f6935f): created successfully Sep 25 17:25:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5e9241-1183-42c0-a5d7-c546f8bdb810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:32 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Flow 'volume_create_manager' (af427f98-bf38-4b72-9bc5-b38f207dc214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:32 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-031bb77f-9ca1-4ffe-8e76-94e36032fccd tempest-ProjectMemberTests-1497756053 None] Created volume successfully. Sep 25 17:25:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-13e3ff0d-6489-4ad6-bdbe-311457fddf93 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-4645d298-8ae1-4d18-a436-dbd606c3cd96-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-13e3ff0d-6489-4ad6-bdbe-311457fddf93 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-4645d298-8ae1-4d18-a436-dbd606c3cd96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-13e3ff0d-6489-4ad6-bdbe-311457fddf93 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-quobyte-6d101d00-fe5f-4f8e-a08c-829aa804465a" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-13e3ff0d-6489-4ad6-bdbe-311457fddf93 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-6d101d00-fe5f-4f8e-a08c-829aa804465a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-13e3ff0d-6489-4ad6-bdbe-311457fddf93 tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-quobyte-4645d298-8ae1-4d18-a436-dbd606c3cd96" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:32 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-13e3ff0d-6489-4ad6-bdbe-311457fddf93 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-4645d298-8ae1-4d18-a436-dbd606c3cd96" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-13e3ff0d-6489-4ad6-bdbe-311457fddf93 tempest-ProjectReaderTests-2080899454 None] Deleting offline snapshot 4645d298-8ae1-4d18-a436-dbd606c3cd96 of volume 6d101d00-fe5f-4f8e-a08c-829aa804465a {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:25:32 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-13e3ff0d-6489-4ad6-bdbe-311457fddf93 tempest-ProjectReaderTests-2080899454 None] snapshot_file for this snap is: volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.4645d298-8ae1-4d18-a436-dbd606c3cd96 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:25:32 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc957fa5-988c-409f-b164-68ce48d798a3]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-13e3ff0d-6489-4ad6-bdbe-311457fddf93 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.4645d298-8ae1-4d18-a436-dbd606c3cd96 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:32 devstack sudo[109215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.4645d298-8ae1-4d18-a436-dbd606c3cd96 Sep 25 17:25:32 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:33 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-13e3ff0d-6489-4ad6-bdbe-311457fddf93 tempest-ProjectReaderTests-2080899454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.4645d298-8ae1-4d18-a436-dbd606c3cd96" returned: 0 in 0.442s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-13e3ff0d-6489-4ad6-bdbe-311457fddf93 tempest-ProjectReaderTests-2080899454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d101d00-fe5f-4f8e-a08c-829aa804465a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:25:33 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae4227e-fba5-41f4-af90-a6f7c95e8aeb]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-13e3ff0d-6489-4ad6-bdbe-311457fddf93 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:33 devstack sudo[109221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a Sep 25 17:25:33 devstack sudo[109221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b441dc39-eded-41fb-a6d1-1ca89815942f tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b441dc39-eded-41fb-a6d1-1ca89815942f tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-b441dc39-eded-41fb-a6d1-1ca89815942f tempest-ProjectMemberTests-1497756053 None] Creating offline snapshot 51af8ea2-5159-4ffa-a1d8-d3fa719043b9 of volume 31a15cc3-f697-43ef-a85b-082613f6935f {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:25:33 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f4b1d3-3953-4604-b567-d60740ad1886]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b441dc39-eded-41fb-a6d1-1ca89815942f tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:33 devstack sudo[109223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f Sep 25 17:25:33 devstack sudo[109223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:33 devstack sudo[109221]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-13e3ff0d-6489-4ad6-bdbe-311457fddf93 tempest-ProjectReaderTests-2080899454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a" returned: 0 in 0.513s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-13e3ff0d-6489-4ad6-bdbe-311457fddf93 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.4645d298-8ae1-4d18-a436-dbd606c3cd96 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:33 devstack sudo[109230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.4645d298-8ae1-4d18-a436-dbd606c3cd96 Sep 25 17:25:33 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:34 devstack sudo[109223]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b441dc39-eded-41fb-a6d1-1ca89815942f tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f" returned: 0 in 0.492s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b441dc39-eded-41fb-a6d1-1ca89815942f tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.51af8ea2-5159-4ffa-a1d8-d3fa719043b9 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:34 devstack sudo[109235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.51af8ea2-5159-4ffa-a1d8-d3fa719043b9 1G Sep 25 17:25:34 devstack sudo[109235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:34 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-13e3ff0d-6489-4ad6-bdbe-311457fddf93 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.4645d298-8ae1-4d18-a436-dbd606c3cd96" returned: 0 in 0.429s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-13e3ff0d-6489-4ad6-bdbe-311457fddf93 tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.4645d298-8ae1-4d18-a436-dbd606c3cd96 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:34 devstack sudo[109241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.4645d298-8ae1-4d18-a436-dbd606c3cd96 Sep 25 17:25:34 devstack sudo[109241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:34 devstack sudo[109235]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b441dc39-eded-41fb-a6d1-1ca89815942f tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.51af8ea2-5159-4ffa-a1d8-d3fa719043b9 1G" returned: 0 in 0.497s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b441dc39-eded-41fb-a6d1-1ca89815942f tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31a15cc3-f697-43ef-a85b-082613f6935f -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.51af8ea2-5159-4ffa-a1d8-d3fa719043b9 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:34 devstack sudo[109241]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-13e3ff0d-6489-4ad6-bdbe-311457fddf93 tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a.4645d298-8ae1-4d18-a436-dbd606c3cd96" returned: 0 in 0.303s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:34 devstack sudo[109248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31a15cc3-f697-43ef-a85b-082613f6935f -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.51af8ea2-5159-4ffa-a1d8-d3fa719043b9 Sep 25 17:25:34 devstack sudo[109248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-13e3ff0d-6489-4ad6-bdbe-311457fddf93 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-4645d298-8ae1-4d18-a436-dbd606c3cd96" released by "_delete_snapshot" :: held 1.821s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-13e3ff0d-6489-4ad6-bdbe-311457fddf93 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-6d101d00-fe5f-4f8e-a08c-829aa804465a" released by "delete_snapshot" :: held 1.845s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:34 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-13e3ff0d-6489-4ad6-bdbe-311457fddf93 tempest-ProjectReaderTests-2080899454 None] Created reservations ['abfb96e4-e348-425e-accb-0ab809a7dd44', 'ffe8d265-8ada-4921-b713-2189c19e0850', '3ac26b07-a208-410d-9ba9-01bbc373b156', '5b294a6d-a892-4d4b-98e6-495b604ee94d'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:34 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-13e3ff0d-6489-4ad6-bdbe-311457fddf93 tempest-ProjectReaderTests-2080899454 None] Delete snapshot completed successfully. Sep 25 17:25:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-13e3ff0d-6489-4ad6-bdbe-311457fddf93 tempest-ProjectReaderTests-2080899454 None] Lock "cinder-4645d298-8ae1-4d18-a436-dbd606c3cd96-delete_snapshot" released by "delete_snapshot" :: held 1.986s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:34 devstack sudo[109248]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b441dc39-eded-41fb-a6d1-1ca89815942f tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31a15cc3-f697-43ef-a85b-082613f6935f -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.51af8ea2-5159-4ffa-a1d8-d3fa719043b9" returned: 0 in 0.296s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:34 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-b441dc39-eded-41fb-a6d1-1ca89815942f tempest-ProjectMemberTests-1497756053 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.51af8ea2-5159-4ffa-a1d8-d3fa719043b9 is being set with open permissions: ugo+rw Sep 25 17:25:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b441dc39-eded-41fb-a6d1-1ca89815942f tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.51af8ea2-5159-4ffa-a1d8-d3fa719043b9 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:34 devstack sudo[109253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.51af8ea2-5159-4ffa-a1d8-d3fa719043b9 Sep 25 17:25:34 devstack sudo[109253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6a22187a-ae5d-44f3-a0da-fe140fc769fb tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-6d101d00-fe5f-4f8e-a08c-829aa804465a-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6a22187a-ae5d-44f3-a0da-fe140fc769fb tempest-ProjectReaderTests-2080899454 None] Lock "cinder-6d101d00-fe5f-4f8e-a08c-829aa804465a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6a22187a-ae5d-44f3-a0da-fe140fc769fb tempest-ProjectReaderTests-2080899454 None] Acquiring lock "cinder-quobyte-6d101d00-fe5f-4f8e-a08c-829aa804465a" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:34 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6a22187a-ae5d-44f3-a0da-fe140fc769fb tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-6d101d00-fe5f-4f8e-a08c-829aa804465a" acquired by "delete_volume" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:35 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c025b14-d38a-48b5-968e-c28edb22481f]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6a22187a-ae5d-44f3-a0da-fe140fc769fb tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:35 devstack sudo[109253]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b441dc39-eded-41fb-a6d1-1ca89815942f tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.51af8ea2-5159-4ffa-a1d8-d3fa719043b9" returned: 0 in 0.279s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b441dc39-eded-41fb-a6d1-1ca89815942f tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:35 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a Sep 25 17:25:35 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:35 devstack sudo[109258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.info Sep 25 17:25:35 devstack sudo[109258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:35 devstack sudo[109258]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b441dc39-eded-41fb-a6d1-1ca89815942f tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.info" returned: 0 in 0.268s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:35 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-b441dc39-eded-41fb-a6d1-1ca89815942f tempest-ProjectMemberTests-1497756053 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.info is being set with open permissions: ugo+rw Sep 25 17:25:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b441dc39-eded-41fb-a6d1-1ca89815942f tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:35 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6a22187a-ae5d-44f3-a0da-fe140fc769fb tempest-ProjectReaderTests-2080899454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a" returned: 0 in 0.392s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6a22187a-ae5d-44f3-a0da-fe140fc769fb tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:35 devstack sudo[109264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.info Sep 25 17:25:35 devstack sudo[109264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:35 devstack sudo[109265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a Sep 25 17:25:35 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:35 devstack sudo[109264]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-b441dc39-eded-41fb-a6d1-1ca89815942f tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.info" returned: 0 in 0.250s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-b441dc39-eded-41fb-a6d1-1ca89815942f tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.180s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:35 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6a22187a-ae5d-44f3-a0da-fe140fc769fb tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-6d101d00-fe5f-4f8e-a08c-829aa804465a" returned: 0 in 0.267s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:35 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6a22187a-ae5d-44f3-a0da-fe140fc769fb tempest-ProjectReaderTests-2080899454 None] Lock "cinder-quobyte-6d101d00-fe5f-4f8e-a08c-829aa804465a" released by "delete_volume" :: held 0.744s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:35 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-b441dc39-eded-41fb-a6d1-1ca89815942f tempest-ProjectMemberTests-1497756053 None] Create snapshot completed successfully Sep 25 17:25:35 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-6a22187a-ae5d-44f3-a0da-fe140fc769fb tempest-ProjectReaderTests-2080899454 None] Created reservations ['b082a8cd-8da2-4ea1-b860-d5c1efa443ef', '357b87a5-4829-4e4b-b7c6-9aeb87e45fd9', '28ce8bb5-977e-4057-b59b-2ab219fa5f24', '96a78ed5-acc9-4be0-971c-a9478bb13a86'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6a22187a-ae5d-44f3-a0da-fe140fc769fb tempest-ProjectReaderTests-2080899454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6a22187a-ae5d-44f3-a0da-fe140fc769fb tempest-ProjectReaderTests-2080899454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:35 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6a22187a-ae5d-44f3-a0da-fe140fc769fb tempest-ProjectReaderTests-2080899454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:35 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6a22187a-ae5d-44f3-a0da-fe140fc769fb tempest-ProjectReaderTests-2080899454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6a22187a-ae5d-44f3-a0da-fe140fc769fb tempest-ProjectReaderTests-2080899454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:35 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6a22187a-ae5d-44f3-a0da-fe140fc769fb tempest-ProjectReaderTests-2080899454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:35 devstack sudo[109270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:25:35 devstack sudo[109270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:36 devstack sudo[109270]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6a22187a-ae5d-44f3-a0da-fe140fc769fb tempest-ProjectReaderTests-2080899454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.259s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:36 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-6a22187a-ae5d-44f3-a0da-fe140fc769fb tempest-ProjectReaderTests-2080899454 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:36 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-6a22187a-ae5d-44f3-a0da-fe140fc769fb tempest-ProjectReaderTests-2080899454 None] Deleted volume successfully. Sep 25 17:25:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6a22187a-ae5d-44f3-a0da-fe140fc769fb tempest-ProjectReaderTests-2080899454 None] Lock "cinder-6d101d00-fe5f-4f8e-a08c-829aa804465a-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a8161296-d6dc-4f86-8235-418267f8e47a tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-51af8ea2-5159-4ffa-a1d8-d3fa719043b9-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a8161296-d6dc-4f86-8235-418267f8e47a tempest-ProjectMemberTests-1497756053 None] Lock "cinder-51af8ea2-5159-4ffa-a1d8-d3fa719043b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a8161296-d6dc-4f86-8235-418267f8e47a tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-31a15cc3-f697-43ef-a85b-082613f6935f" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a8161296-d6dc-4f86-8235-418267f8e47a tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-31a15cc3-f697-43ef-a85b-082613f6935f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a8161296-d6dc-4f86-8235-418267f8e47a tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-51af8ea2-5159-4ffa-a1d8-d3fa719043b9" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:36 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a8161296-d6dc-4f86-8235-418267f8e47a tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-51af8ea2-5159-4ffa-a1d8-d3fa719043b9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-a8161296-d6dc-4f86-8235-418267f8e47a tempest-ProjectMemberTests-1497756053 None] Deleting offline snapshot 51af8ea2-5159-4ffa-a1d8-d3fa719043b9 of volume 31a15cc3-f697-43ef-a85b-082613f6935f {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:25:36 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-a8161296-d6dc-4f86-8235-418267f8e47a tempest-ProjectMemberTests-1497756053 None] snapshot_file for this snap is: volume-31a15cc3-f697-43ef-a85b-082613f6935f.51af8ea2-5159-4ffa-a1d8-d3fa719043b9 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:25:36 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e31be5-b6a1-4ca2-974b-3d9aec55c9bd]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:36 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a8161296-d6dc-4f86-8235-418267f8e47a tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.51af8ea2-5159-4ffa-a1d8-d3fa719043b9 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:36 devstack sudo[109273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.51af8ea2-5159-4ffa-a1d8-d3fa719043b9 Sep 25 17:25:36 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:37 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a8161296-d6dc-4f86-8235-418267f8e47a tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.51af8ea2-5159-4ffa-a1d8-d3fa719043b9" returned: 0 in 0.467s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:37 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-a8161296-d6dc-4f86-8235-418267f8e47a tempest-ProjectMemberTests-1497756053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31a15cc3-f697-43ef-a85b-082613f6935f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:25:37 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f5c61d-7bc4-4397-bf75-5c4282be2b46]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a8161296-d6dc-4f86-8235-418267f8e47a tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:37 devstack sudo[109278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f Sep 25 17:25:37 devstack sudo[109278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:37 devstack sudo[109278]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a8161296-d6dc-4f86-8235-418267f8e47a tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f" returned: 0 in 0.424s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:37 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a8161296-d6dc-4f86-8235-418267f8e47a tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.51af8ea2-5159-4ffa-a1d8-d3fa719043b9 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:37 devstack sudo[109284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.51af8ea2-5159-4ffa-a1d8-d3fa719043b9 Sep 25 17:25:37 devstack sudo[109284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:38 devstack sudo[109284]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a8161296-d6dc-4f86-8235-418267f8e47a tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.51af8ea2-5159-4ffa-a1d8-d3fa719043b9" returned: 0 in 0.357s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a8161296-d6dc-4f86-8235-418267f8e47a tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.51af8ea2-5159-4ffa-a1d8-d3fa719043b9 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:38 devstack sudo[109289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.51af8ea2-5159-4ffa-a1d8-d3fa719043b9 Sep 25 17:25:38 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:38 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a8161296-d6dc-4f86-8235-418267f8e47a tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f.51af8ea2-5159-4ffa-a1d8-d3fa719043b9" returned: 0 in 0.281s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a8161296-d6dc-4f86-8235-418267f8e47a tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-51af8ea2-5159-4ffa-a1d8-d3fa719043b9" released by "_delete_snapshot" :: held 1.657s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a8161296-d6dc-4f86-8235-418267f8e47a tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-31a15cc3-f697-43ef-a85b-082613f6935f" released by "delete_snapshot" :: held 1.684s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:38 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-a8161296-d6dc-4f86-8235-418267f8e47a tempest-ProjectMemberTests-1497756053 None] Created reservations ['a2013d0b-8415-4832-959e-ee6daad8428e', '7ae2fbd7-8961-4163-bc54-530a5eba77ec', '388799e0-6519-46b3-b702-925901fb7c90', '5a0adbad-c23e-438b-af1b-0ef5399813ff'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:38 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-a8161296-d6dc-4f86-8235-418267f8e47a tempest-ProjectMemberTests-1497756053 None] Delete snapshot completed successfully. Sep 25 17:25:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a8161296-d6dc-4f86-8235-418267f8e47a tempest-ProjectMemberTests-1497756053 None] Lock "cinder-51af8ea2-5159-4ffa-a1d8-d3fa719043b9-delete_snapshot" released by "delete_snapshot" :: held 1.842s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-51d879b2-af8b-4558-900c-1d28d151af4e tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-31a15cc3-f697-43ef-a85b-082613f6935f-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-51d879b2-af8b-4558-900c-1d28d151af4e tempest-ProjectMemberTests-1497756053 None] Lock "cinder-31a15cc3-f697-43ef-a85b-082613f6935f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-51d879b2-af8b-4558-900c-1d28d151af4e tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-31a15cc3-f697-43ef-a85b-082613f6935f" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:38 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-51d879b2-af8b-4558-900c-1d28d151af4e tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-31a15cc3-f697-43ef-a85b-082613f6935f" acquired by "delete_volume" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:38 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2b7c80-b0ec-4626-8aff-971e0e9f0286]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:38 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-51d879b2-af8b-4558-900c-1d28d151af4e tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:39 devstack sudo[109292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f Sep 25 17:25:39 devstack sudo[109292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:39 devstack sudo[109292]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-51d879b2-af8b-4558-900c-1d28d151af4e tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f" returned: 0 in 0.379s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-51d879b2-af8b-4558-900c-1d28d151af4e tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:39 devstack sudo[109298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f Sep 25 17:25:39 devstack sudo[109298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:39 devstack sudo[109298]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-51d879b2-af8b-4558-900c-1d28d151af4e tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-31a15cc3-f697-43ef-a85b-082613f6935f" returned: 0 in 0.253s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:39 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-51d879b2-af8b-4558-900c-1d28d151af4e tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-31a15cc3-f697-43ef-a85b-082613f6935f" released by "delete_volume" :: held 0.708s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:39 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-51d879b2-af8b-4558-900c-1d28d151af4e tempest-ProjectMemberTests-1497756053 None] Created reservations ['747dca15-2ac8-41bc-a220-0d6043c222e3', '89c25f7a-5376-40d9-a0ec-6d2f9f7ff08a', 'd87bcd75-64bc-49fd-9e05-4c1f63907210', '75a325c6-1ec6-4aaa-ad84-f1a28e975c12'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-51d879b2-af8b-4558-900c-1d28d151af4e tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-51d879b2-af8b-4558-900c-1d28d151af4e tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-51d879b2-af8b-4558-900c-1d28d151af4e tempest-ProjectMemberTests-1497756053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:39 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-51d879b2-af8b-4558-900c-1d28d151af4e tempest-ProjectMemberTests-1497756053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-51d879b2-af8b-4558-900c-1d28d151af4e tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-51d879b2-af8b-4558-900c-1d28d151af4e tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:39 devstack sudo[109301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:25:39 devstack sudo[109301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:40 devstack sudo[109301]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-51d879b2-af8b-4558-900c-1d28d151af4e tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.288s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-51d879b2-af8b-4558-900c-1d28d151af4e tempest-ProjectMemberTests-1497756053 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:40 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-51d879b2-af8b-4558-900c-1d28d151af4e tempest-ProjectMemberTests-1497756053 None] Deleted volume successfully. Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-51d879b2-af8b-4558-900c-1d28d151af4e tempest-ProjectMemberTests-1497756053 None] Lock "cinder-31a15cc3-f697-43ef-a85b-082613f6935f-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Flow 'volume_create_manager' (f5d0e02f-7c56-461d-b1db-a2963088a3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19cc1d74-331b-4d96-8809-eb58f82f6042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19cc1d74-331b-4d96-8809-eb58f82f6042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1143979332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97619a2-9e54-457c-ad79-3e9491174606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31fdfb42d1d48219cd53e16d4a0131f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:40Z,use_quota=True,user_id='645f5007ad61465e9de1ac84410dacf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8059d67e-e219-47ab-8298-7080f097d1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8059d67e-e219-47ab-8298-7080f097d1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799da1c8-7379-4250-a1b8-36d1a389f91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799da1c8-7379-4250-a1b8-36d1a389f91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c97619a2-9e54-457c-ad79-3e9491174606', 'volume_name': 'volume-c97619a2-9e54-457c-ad79-3e9491174606', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2acaa8-486a-4347-adc6-b8ed7a28f5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2acaa8-486a-4347-adc6-b8ed7a28f5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6279265a-e812-48df-842d-8d50ad41d89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:40 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Volume c97619a2-9e54-457c-ad79-3e9491174606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c97619a2-9e54-457c-ad79-3e9491174606', 'volume_size': 1} Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1143979332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97619a2-9e54-457c-ad79-3e9491174606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31fdfb42d1d48219cd53e16d4a0131f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:40Z,use_quota=True,user_id='645f5007ad61465e9de1ac84410dacf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Creating volume c97619a2-9e54-457c-ad79-3e9491174606 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:40 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:25:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:40 devstack sudo[109304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606 1073741824 Sep 25 17:25:40 devstack sudo[109304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:41 devstack sudo[109304]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606 1073741824" returned: 0 in 0.435s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:41 devstack sudo[109309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606 Sep 25 17:25:41 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:41 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606" returned: 0 in 0.249s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6279265a-e812-48df-842d-8d50ad41d89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c97619a2-9e54-457c-ad79-3e9491174606', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e023ec-c5f1-41a9-ae8c-6ea92ff59396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:41 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Volume volume-c97619a2-9e54-457c-ad79-3e9491174606 (c97619a2-9e54-457c-ad79-3e9491174606): created successfully Sep 25 17:25:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e023ec-c5f1-41a9-ae8c-6ea92ff59396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:41 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Flow 'volume_create_manager' (f5d0e02f-7c56-461d-b1db-a2963088a3d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:41 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-8d889fba-9959-4f3e-9056-ecfaf0532e7e tempest-ProjectMemberTests-1497756053 None] Created volume successfully. Sep 25 17:25:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9e7d4a32-3e9a-49a3-85df-f67076e10025 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9e7d4a32-3e9a-49a3-85df-f67076e10025 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-9e7d4a32-3e9a-49a3-85df-f67076e10025 tempest-ProjectMemberTests-1497756053 None] Creating offline snapshot 890bdc9f-8894-48a7-8b7a-72598b46ecb5 of volume c97619a2-9e54-457c-ad79-3e9491174606 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:25:41 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[695bdb0b-fdc6-4d0f-99d6-fa3c8787af54]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e7d4a32-3e9a-49a3-85df-f67076e10025 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:41 devstack sudo[109318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606 Sep 25 17:25:41 devstack sudo[109318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:42 devstack sudo[109318]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e7d4a32-3e9a-49a3-85df-f67076e10025 tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606" returned: 0 in 0.410s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e7d4a32-3e9a-49a3-85df-f67076e10025 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.890bdc9f-8894-48a7-8b7a-72598b46ecb5 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:42 devstack sudo[109323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.890bdc9f-8894-48a7-8b7a-72598b46ecb5 1G Sep 25 17:25:42 devstack sudo[109323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:42 devstack sudo[109323]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e7d4a32-3e9a-49a3-85df-f67076e10025 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.890bdc9f-8894-48a7-8b7a-72598b46ecb5 1G" returned: 0 in 0.418s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e7d4a32-3e9a-49a3-85df-f67076e10025 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c97619a2-9e54-457c-ad79-3e9491174606 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.890bdc9f-8894-48a7-8b7a-72598b46ecb5 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:42 devstack sudo[109329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c97619a2-9e54-457c-ad79-3e9491174606 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.890bdc9f-8894-48a7-8b7a-72598b46ecb5 Sep 25 17:25:42 devstack sudo[109329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:42 devstack sudo[109329]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e7d4a32-3e9a-49a3-85df-f67076e10025 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c97619a2-9e54-457c-ad79-3e9491174606 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.890bdc9f-8894-48a7-8b7a-72598b46ecb5" returned: 0 in 0.272s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:42 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-9e7d4a32-3e9a-49a3-85df-f67076e10025 tempest-ProjectMemberTests-1497756053 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.890bdc9f-8894-48a7-8b7a-72598b46ecb5 is being set with open permissions: ugo+rw Sep 25 17:25:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e7d4a32-3e9a-49a3-85df-f67076e10025 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.890bdc9f-8894-48a7-8b7a-72598b46ecb5 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:42 devstack sudo[109334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.890bdc9f-8894-48a7-8b7a-72598b46ecb5 Sep 25 17:25:42 devstack sudo[109334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:43 devstack sudo[109334]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e7d4a32-3e9a-49a3-85df-f67076e10025 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.890bdc9f-8894-48a7-8b7a-72598b46ecb5" returned: 0 in 0.234s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e7d4a32-3e9a-49a3-85df-f67076e10025 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:43 devstack sudo[109337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.info Sep 25 17:25:43 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:43 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e7d4a32-3e9a-49a3-85df-f67076e10025 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.info" returned: 0 in 0.253s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:43 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-9e7d4a32-3e9a-49a3-85df-f67076e10025 tempest-ProjectMemberTests-1497756053 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.info is being set with open permissions: ugo+rw Sep 25 17:25:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e7d4a32-3e9a-49a3-85df-f67076e10025 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:43 devstack sudo[109340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.info Sep 25 17:25:43 devstack sudo[109340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:43 devstack sudo[109340]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9e7d4a32-3e9a-49a3-85df-f67076e10025 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.info" returned: 0 in 0.263s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9e7d4a32-3e9a-49a3-85df-f67076e10025 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.946s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:43 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=206,cinder:UPDATE=267,cinder:INSERT=76,cinder:DELETE=23 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:25:43 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-9e7d4a32-3e9a-49a3-85df-f67076e10025 tempest-ProjectMemberTests-1497756053 None] Create snapshot completed successfully Sep 25 17:25:44 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-10cc2d67-161b-4ae9-be0a-535ab361686d tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-890bdc9f-8894-48a7-8b7a-72598b46ecb5-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-10cc2d67-161b-4ae9-be0a-535ab361686d tempest-ProjectMemberTests-1497756053 None] Lock "cinder-890bdc9f-8894-48a7-8b7a-72598b46ecb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-10cc2d67-161b-4ae9-be0a-535ab361686d tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-c97619a2-9e54-457c-ad79-3e9491174606" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-10cc2d67-161b-4ae9-be0a-535ab361686d tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-c97619a2-9e54-457c-ad79-3e9491174606" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-10cc2d67-161b-4ae9-be0a-535ab361686d tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-890bdc9f-8894-48a7-8b7a-72598b46ecb5" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-10cc2d67-161b-4ae9-be0a-535ab361686d tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-890bdc9f-8894-48a7-8b7a-72598b46ecb5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-10cc2d67-161b-4ae9-be0a-535ab361686d tempest-ProjectMemberTests-1497756053 None] Deleting offline snapshot 890bdc9f-8894-48a7-8b7a-72598b46ecb5 of volume c97619a2-9e54-457c-ad79-3e9491174606 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:25:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-10cc2d67-161b-4ae9-be0a-535ab361686d tempest-ProjectMemberTests-1497756053 None] snapshot_file for this snap is: volume-c97619a2-9e54-457c-ad79-3e9491174606.890bdc9f-8894-48a7-8b7a-72598b46ecb5 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:25:45 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e482cd-158e-4ff9-86b3-692a62db407d]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-10cc2d67-161b-4ae9-be0a-535ab361686d tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.890bdc9f-8894-48a7-8b7a-72598b46ecb5 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:45 devstack sudo[109379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.890bdc9f-8894-48a7-8b7a-72598b46ecb5 Sep 25 17:25:45 devstack sudo[109379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:45 devstack sudo[109379]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-10cc2d67-161b-4ae9-be0a-535ab361686d tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.890bdc9f-8894-48a7-8b7a-72598b46ecb5" returned: 0 in 0.400s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:45 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-10cc2d67-161b-4ae9-be0a-535ab361686d tempest-ProjectMemberTests-1497756053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c97619a2-9e54-457c-ad79-3e9491174606(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:25:45 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b62374-c34f-429c-9867-992d14d036e9]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-10cc2d67-161b-4ae9-be0a-535ab361686d tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:45 devstack sudo[109385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606 Sep 25 17:25:45 devstack sudo[109385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:45 devstack sudo[109385]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-10cc2d67-161b-4ae9-be0a-535ab361686d tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606" returned: 0 in 0.410s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-10cc2d67-161b-4ae9-be0a-535ab361686d tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.890bdc9f-8894-48a7-8b7a-72598b46ecb5 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:45 devstack sudo[109391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.890bdc9f-8894-48a7-8b7a-72598b46ecb5 Sep 25 17:25:45 devstack sudo[109391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:46 devstack sudo[109391]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-10cc2d67-161b-4ae9-be0a-535ab361686d tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.890bdc9f-8894-48a7-8b7a-72598b46ecb5" returned: 0 in 0.379s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-10cc2d67-161b-4ae9-be0a-535ab361686d tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.890bdc9f-8894-48a7-8b7a-72598b46ecb5 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:46 devstack sudo[109396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.890bdc9f-8894-48a7-8b7a-72598b46ecb5 Sep 25 17:25:46 devstack sudo[109396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:46 devstack sudo[109396]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:46 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-10cc2d67-161b-4ae9-be0a-535ab361686d tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606.890bdc9f-8894-48a7-8b7a-72598b46ecb5" returned: 0 in 0.261s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:46 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-10cc2d67-161b-4ae9-be0a-535ab361686d tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-890bdc9f-8894-48a7-8b7a-72598b46ecb5" released by "_delete_snapshot" :: held 1.577s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:46 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-10cc2d67-161b-4ae9-be0a-535ab361686d tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-c97619a2-9e54-457c-ad79-3e9491174606" released by "delete_snapshot" :: held 1.599s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:46 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:UPDATE=262,cinder:SELECT=194,cinder:INSERT=75,cinder:DELETE=21 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:25:46 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-10cc2d67-161b-4ae9-be0a-535ab361686d tempest-ProjectMemberTests-1497756053 None] Created reservations ['3c8875e7-5786-46f6-8e34-af95f81a0418', '3fcd8e8a-6ad7-448f-8bbd-013f76f4e269', 'a2e34a7f-54a5-45a7-a840-c393558410ee', 'a6502a15-d2ec-4f02-82fd-fa97c55d6777'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:46 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-10cc2d67-161b-4ae9-be0a-535ab361686d tempest-ProjectMemberTests-1497756053 None] Delete snapshot completed successfully. Sep 25 17:25:46 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-10cc2d67-161b-4ae9-be0a-535ab361686d tempest-ProjectMemberTests-1497756053 None] Lock "cinder-890bdc9f-8894-48a7-8b7a-72598b46ecb5-delete_snapshot" released by "delete_snapshot" :: held 1.774s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a26f4e58-d245-480c-957e-f7b3871f8989 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-c97619a2-9e54-457c-ad79-3e9491174606-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a26f4e58-d245-480c-957e-f7b3871f8989 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-c97619a2-9e54-457c-ad79-3e9491174606-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a26f4e58-d245-480c-957e-f7b3871f8989 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "cinder-quobyte-c97619a2-9e54-457c-ad79-3e9491174606" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:47 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a26f4e58-d245-480c-957e-f7b3871f8989 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-c97619a2-9e54-457c-ad79-3e9491174606" acquired by "delete_volume" :: waited 0.015s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:47 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3066856-c9c0-4917-aa19-9f0350be6324]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a26f4e58-d245-480c-957e-f7b3871f8989 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:47 devstack sudo[109399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606 Sep 25 17:25:47 devstack sudo[109399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:47 devstack sudo[109399]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a26f4e58-d245-480c-957e-f7b3871f8989 tempest-ProjectMemberTests-1497756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606" returned: 0 in 0.396s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a26f4e58-d245-480c-957e-f7b3871f8989 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:47 devstack sudo[109405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606 Sep 25 17:25:47 devstack sudo[109405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:47 devstack sudo[109405]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:47 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a26f4e58-d245-480c-957e-f7b3871f8989 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-c97619a2-9e54-457c-ad79-3e9491174606" returned: 0 in 0.260s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:48 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a26f4e58-d245-480c-957e-f7b3871f8989 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-quobyte-c97619a2-9e54-457c-ad79-3e9491174606" released by "delete_volume" :: held 0.733s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:48 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-a26f4e58-d245-480c-957e-f7b3871f8989 tempest-ProjectMemberTests-1497756053 None] Created reservations ['c82598c0-99ec-4b8b-81c1-5a38befaff77', '70fb236a-fd23-4383-993c-087c39cfe6a4', '229ac01b-14ce-4c1c-823d-27e851950175', 'f42abca7-5821-4f62-b1ab-ddaa14b411d6'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a26f4e58-d245-480c-957e-f7b3871f8989 tempest-ProjectMemberTests-1497756053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a26f4e58-d245-480c-957e-f7b3871f8989 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a26f4e58-d245-480c-957e-f7b3871f8989 tempest-ProjectMemberTests-1497756053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:48 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-a26f4e58-d245-480c-957e-f7b3871f8989 tempest-ProjectMemberTests-1497756053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-a26f4e58-d245-480c-957e-f7b3871f8989 tempest-ProjectMemberTests-1497756053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a26f4e58-d245-480c-957e-f7b3871f8989 tempest-ProjectMemberTests-1497756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:48 devstack sudo[109408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:25:48 devstack sudo[109408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:48 devstack sudo[109408]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:48 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-a26f4e58-d245-480c-957e-f7b3871f8989 tempest-ProjectMemberTests-1497756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.280s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:48 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-a26f4e58-d245-480c-957e-f7b3871f8989 tempest-ProjectMemberTests-1497756053 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:48 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-a26f4e58-d245-480c-957e-f7b3871f8989 tempest-ProjectMemberTests-1497756053 None] Deleted volume successfully. Sep 25 17:25:48 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-a26f4e58-d245-480c-957e-f7b3871f8989 tempest-ProjectMemberTests-1497756053 None] Lock "cinder-c97619a2-9e54-457c-ad79-3e9491174606-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:25:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:53 devstack sudo[109413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:25:53 devstack sudo[109413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:53 devstack sudo[109413]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.245s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:53 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:25:53 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 28 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:25:53 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:25:58 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=14 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:25:58 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=8,cinder:INSERT=4,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:25:59 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Flow 'volume_create_manager' (775e57e9-8886-47e6-ba85-3b0c5d190dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1763e9b-e97c-46e4-a901-31379c25884f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1763e9b-e97c-46e4-a901-31379c25884f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1490607182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697f6a1d-cee0-4629-8b8d-746e530a08f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a3a9d327014a8b864852d00c2cee16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:26:00Z,use_quota=True,user_id='da86ee46828b4c0ea291f049e86f152b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:59 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5bd9ca-7ec4-4bde-a186-444e8fe88b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5bd9ca-7ec4-4bde-a186-444e8fe88b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d35e5e-6991-4071-be51-3e6d10e142e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d35e5e-6991-4071-be51-3e6d10e142e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '697f6a1d-cee0-4629-8b8d-746e530a08f5', 'volume_name': 'volume-697f6a1d-cee0-4629-8b8d-746e530a08f5', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922a897b-7365-4dfb-b5b8-09d903afc474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922a897b-7365-4dfb-b5b8-09d903afc474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d704da-04cb-4600-9056-dd6eb28af746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:00 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Volume 697f6a1d-cee0-4629-8b8d-746e530a08f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-697f6a1d-cee0-4629-8b8d-746e530a08f5', 'volume_size': 1} Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1490607182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697f6a1d-cee0-4629-8b8d-746e530a08f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a3a9d327014a8b864852d00c2cee16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:26:00Z,use_quota=True,user_id='da86ee46828b4c0ea291f049e86f152b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Creating volume 697f6a1d-cee0-4629-8b8d-746e530a08f5 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:26:00 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-697f6a1d-cee0-4629-8b8d-746e530a08f5 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:00 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-697f6a1d-cee0-4629-8b8d-746e530a08f5 1073741824 Sep 25 17:26:00 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:00 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-697f6a1d-cee0-4629-8b8d-746e530a08f5 1073741824" returned: 0 in 0.436s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-697f6a1d-cee0-4629-8b8d-746e530a08f5 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:00 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-697f6a1d-cee0-4629-8b8d-746e530a08f5 Sep 25 17:26:00 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:00 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-697f6a1d-cee0-4629-8b8d-746e530a08f5" returned: 0 in 0.242s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d704da-04cb-4600-9056-dd6eb28af746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-697f6a1d-cee0-4629-8b8d-746e530a08f5', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40b027ea-d106-42ea-9953-5838b9910c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:00 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Volume volume-697f6a1d-cee0-4629-8b8d-746e530a08f5 (697f6a1d-cee0-4629-8b8d-746e530a08f5): created successfully Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40b027ea-d106-42ea-9953-5838b9910c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:00 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Flow 'volume_create_manager' (775e57e9-8886-47e6-ba85-3b0c5d190dc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:00 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-102b8911-9fd9-4246-9984-14e2f202827e tempest-ProjectReaderTests-1883943928 None] Created volume successfully. Sep 25 17:26:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6b748d7e-08aa-4cde-8052-5e016dfda24b tempest-ProjectReaderTests-1883943928 None] Acquiring lock "cinder-697f6a1d-cee0-4629-8b8d-746e530a08f5-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6b748d7e-08aa-4cde-8052-5e016dfda24b tempest-ProjectReaderTests-1883943928 None] Lock "cinder-697f6a1d-cee0-4629-8b8d-746e530a08f5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6b748d7e-08aa-4cde-8052-5e016dfda24b tempest-ProjectReaderTests-1883943928 None] Acquiring lock "cinder-quobyte-697f6a1d-cee0-4629-8b8d-746e530a08f5" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6b748d7e-08aa-4cde-8052-5e016dfda24b tempest-ProjectReaderTests-1883943928 None] Lock "cinder-quobyte-697f6a1d-cee0-4629-8b8d-746e530a08f5" acquired by "delete_volume" :: waited 0.016s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:01 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[648df62e-8417-4b29-b8ad-fc2967e72aa1]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6b748d7e-08aa-4cde-8052-5e016dfda24b tempest-ProjectReaderTests-1883943928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-697f6a1d-cee0-4629-8b8d-746e530a08f5 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:01 devstack sudo[109426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-697f6a1d-cee0-4629-8b8d-746e530a08f5 Sep 25 17:26:01 devstack sudo[109426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:01 devstack sudo[109426]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6b748d7e-08aa-4cde-8052-5e016dfda24b tempest-ProjectReaderTests-1883943928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-697f6a1d-cee0-4629-8b8d-746e530a08f5" returned: 0 in 0.371s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6b748d7e-08aa-4cde-8052-5e016dfda24b tempest-ProjectReaderTests-1883943928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-697f6a1d-cee0-4629-8b8d-746e530a08f5 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:01 devstack sudo[109431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-697f6a1d-cee0-4629-8b8d-746e530a08f5 Sep 25 17:26:01 devstack sudo[109431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:01 devstack sudo[109431]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6b748d7e-08aa-4cde-8052-5e016dfda24b tempest-ProjectReaderTests-1883943928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-697f6a1d-cee0-4629-8b8d-746e530a08f5" returned: 0 in 0.256s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:01 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6b748d7e-08aa-4cde-8052-5e016dfda24b tempest-ProjectReaderTests-1883943928 None] Lock "cinder-quobyte-697f6a1d-cee0-4629-8b8d-746e530a08f5" released by "delete_volume" :: held 0.672s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:01 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-6b748d7e-08aa-4cde-8052-5e016dfda24b tempest-ProjectReaderTests-1883943928 None] Created reservations ['3754e230-5eb6-4c6e-ac4f-4853d6ed2c39', '21bff20c-029f-406a-9efe-2ca2762ef73a', '2a515c27-f003-45de-adaf-a6629f7dd9b2', '946fb88d-c053-4314-a0a1-283a2880f678'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:26:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6b748d7e-08aa-4cde-8052-5e016dfda24b tempest-ProjectReaderTests-1883943928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6b748d7e-08aa-4cde-8052-5e016dfda24b tempest-ProjectReaderTests-1883943928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6b748d7e-08aa-4cde-8052-5e016dfda24b tempest-ProjectReaderTests-1883943928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:01 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-6b748d7e-08aa-4cde-8052-5e016dfda24b tempest-ProjectReaderTests-1883943928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-6b748d7e-08aa-4cde-8052-5e016dfda24b tempest-ProjectReaderTests-1883943928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:01 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6b748d7e-08aa-4cde-8052-5e016dfda24b tempest-ProjectReaderTests-1883943928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:02 devstack sudo[109434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:26:02 devstack sudo[109434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:02 devstack sudo[109434]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-6b748d7e-08aa-4cde-8052-5e016dfda24b tempest-ProjectReaderTests-1883943928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.237s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-6b748d7e-08aa-4cde-8052-5e016dfda24b tempest-ProjectReaderTests-1883943928 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:26:02 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-6b748d7e-08aa-4cde-8052-5e016dfda24b tempest-ProjectReaderTests-1883943928 None] Deleted volume successfully. Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-6b748d7e-08aa-4cde-8052-5e016dfda24b tempest-ProjectReaderTests-1883943928 None] Lock "cinder-697f6a1d-cee0-4629-8b8d-746e530a08f5-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Flow 'volume_create_manager' (41dbe7fb-2e3b-47c9-bbb5-150978814a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2927ccc5-aa48-4733-9fec-b952ecd459d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2927ccc5-aa48-4733-9fec-b952ecd459d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1328464080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f7657a3-053c-4814-9f33-c20d84aee84c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a3a9d327014a8b864852d00c2cee16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:26:03Z,use_quota=True,user_id='da86ee46828b4c0ea291f049e86f152b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2100818-dae2-418d-97e5-878fbe062734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2100818-dae2-418d-97e5-878fbe062734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2e0756-5ca9-4af8-830e-ccb0a7e84a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2e0756-5ca9-4af8-830e-ccb0a7e84a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f7657a3-053c-4814-9f33-c20d84aee84c', 'volume_name': 'volume-4f7657a3-053c-4814-9f33-c20d84aee84c', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c94d8ef1-82cf-44f5-9651-ba5684b9b28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c94d8ef1-82cf-44f5-9651-ba5684b9b28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be011202-41fb-4ea6-ae87-e04f7d66cb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:02 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Volume 4f7657a3-053c-4814-9f33-c20d84aee84c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f7657a3-053c-4814-9f33-c20d84aee84c', 'volume_size': 1} Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1328464080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f7657a3-053c-4814-9f33-c20d84aee84c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a3a9d327014a8b864852d00c2cee16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:26:03Z,use_quota=True,user_id='da86ee46828b4c0ea291f049e86f152b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Creating volume 4f7657a3-053c-4814-9f33-c20d84aee84c {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:26:02 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:26:02 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4f7657a3-053c-4814-9f33-c20d84aee84c 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:02 devstack sudo[109437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4f7657a3-053c-4814-9f33-c20d84aee84c 1073741824 Sep 25 17:26:02 devstack sudo[109437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:03 devstack sudo[109437]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4f7657a3-053c-4814-9f33-c20d84aee84c 1073741824" returned: 0 in 0.424s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4f7657a3-053c-4814-9f33-c20d84aee84c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:03 devstack sudo[109443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4f7657a3-053c-4814-9f33-c20d84aee84c Sep 25 17:26:03 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:03 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4f7657a3-053c-4814-9f33-c20d84aee84c" returned: 0 in 0.256s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:03 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:26:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be011202-41fb-4ea6-ae87-e04f7d66cb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f7657a3-053c-4814-9f33-c20d84aee84c', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c24f6c-7971-4ce7-b003-b5cebe5c62b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:03 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Volume volume-4f7657a3-053c-4814-9f33-c20d84aee84c (4f7657a3-053c-4814-9f33-c20d84aee84c): created successfully Sep 25 17:26:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c24f6c-7971-4ce7-b003-b5cebe5c62b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:03 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Flow 'volume_create_manager' (41dbe7fb-2e3b-47c9-bbb5-150978814a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:03 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-bf6bb0d0-be4f-48b2-870e-e1b22a84aeb6 tempest-ProjectReaderTests-1883943928 None] Created volume successfully. Sep 25 17:26:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0c110636-5318-4496-9c10-bd955f8b579b tempest-ProjectReaderTests-1883943928 None] Acquiring lock "cinder-4f7657a3-053c-4814-9f33-c20d84aee84c-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0c110636-5318-4496-9c10-bd955f8b579b tempest-ProjectReaderTests-1883943928 None] Lock "cinder-4f7657a3-053c-4814-9f33-c20d84aee84c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0c110636-5318-4496-9c10-bd955f8b579b tempest-ProjectReaderTests-1883943928 None] Acquiring lock "cinder-quobyte-4f7657a3-053c-4814-9f33-c20d84aee84c" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:03 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0c110636-5318-4496-9c10-bd955f8b579b tempest-ProjectReaderTests-1883943928 None] Lock "cinder-quobyte-4f7657a3-053c-4814-9f33-c20d84aee84c" acquired by "delete_volume" :: waited 0.014s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:03 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[469e86f1-6f74-4dac-9481-d2a728fae80f]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:03 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0c110636-5318-4496-9c10-bd955f8b579b tempest-ProjectReaderTests-1883943928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4f7657a3-053c-4814-9f33-c20d84aee84c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:03 devstack sudo[109446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4f7657a3-053c-4814-9f33-c20d84aee84c Sep 25 17:26:03 devstack sudo[109446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:04 devstack sudo[109446]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0c110636-5318-4496-9c10-bd955f8b579b tempest-ProjectReaderTests-1883943928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4f7657a3-053c-4814-9f33-c20d84aee84c" returned: 0 in 0.377s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0c110636-5318-4496-9c10-bd955f8b579b tempest-ProjectReaderTests-1883943928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4f7657a3-053c-4814-9f33-c20d84aee84c {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:04 devstack sudo[109451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4f7657a3-053c-4814-9f33-c20d84aee84c Sep 25 17:26:04 devstack sudo[109451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:04 devstack sudo[109451]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0c110636-5318-4496-9c10-bd955f8b579b tempest-ProjectReaderTests-1883943928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-4f7657a3-053c-4814-9f33-c20d84aee84c" returned: 0 in 0.243s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0c110636-5318-4496-9c10-bd955f8b579b tempest-ProjectReaderTests-1883943928 None] Lock "cinder-quobyte-4f7657a3-053c-4814-9f33-c20d84aee84c" released by "delete_volume" :: held 0.661s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:04 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-0c110636-5318-4496-9c10-bd955f8b579b tempest-ProjectReaderTests-1883943928 None] Created reservations ['0b166884-b032-4c68-94be-5c0e4dd65d1c', '102fe366-c9e7-431e-80b0-e1dd45e25885', '55d831d9-77a8-4f74-b17b-75cee4a1f711', '66691719-55e7-4f8a-83b5-d1851dbb59cc'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:26:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0c110636-5318-4496-9c10-bd955f8b579b tempest-ProjectReaderTests-1883943928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0c110636-5318-4496-9c10-bd955f8b579b tempest-ProjectReaderTests-1883943928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:04 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0c110636-5318-4496-9c10-bd955f8b579b tempest-ProjectReaderTests-1883943928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:04 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-0c110636-5318-4496-9c10-bd955f8b579b tempest-ProjectReaderTests-1883943928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-0c110636-5318-4496-9c10-bd955f8b579b tempest-ProjectReaderTests-1883943928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0c110636-5318-4496-9c10-bd955f8b579b tempest-ProjectReaderTests-1883943928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:04 devstack sudo[109454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:26:04 devstack sudo[109454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:04 devstack sudo[109454]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:04 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-0c110636-5318-4496-9c10-bd955f8b579b tempest-ProjectReaderTests-1883943928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.235s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:04 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-0c110636-5318-4496-9c10-bd955f8b579b tempest-ProjectReaderTests-1883943928 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:26:04 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-0c110636-5318-4496-9c10-bd955f8b579b tempest-ProjectReaderTests-1883943928 None] Deleted volume successfully. Sep 25 17:26:04 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-0c110636-5318-4496-9c10-bd955f8b579b tempest-ProjectReaderTests-1883943928 None] Lock "cinder-4f7657a3-053c-4814-9f33-c20d84aee84c-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:14 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:UPDATE=22,cinder:SELECT=17,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:26:14 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=11,cinder:UPDATE=22,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Flow 'volume_create_manager' (46e940d2-d465-4f92-8572-f6e99980a8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e830b508-2a8a-47e4-8dec-7ac87a55a822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e830b508-2a8a-47e4-8dec-7ac87a55a822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1599528358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45142e02-ee4d-445e-92a4-8d2772639278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b24976f9644c4bb5faef0ba705c857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:26:29Z,use_quota=True,user_id='98b1cd20981f4b99a69caeef50f68604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb7e5b6-ff16-47cc-ab7a-ae1a0a8d83f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb7e5b6-ff16-47cc-ab7a-ae1a0a8d83f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7cca91-ff33-4598-88be-25937cd7a7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7cca91-ff33-4598-88be-25937cd7a7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45142e02-ee4d-445e-92a4-8d2772639278', 'volume_name': 'volume-45142e02-ee4d-445e-92a4-8d2772639278', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8c6abb-6345-4c9b-86d1-a52abb70d94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8c6abb-6345-4c9b-86d1-a52abb70d94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1232a89-a64c-4cf4-b3cd-d3276c2a14b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:29 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Volume 45142e02-ee4d-445e-92a4-8d2772639278: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45142e02-ee4d-445e-92a4-8d2772639278', 'volume_size': 1} Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1599528358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45142e02-ee4d-445e-92a4-8d2772639278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b24976f9644c4bb5faef0ba705c857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:26:29Z,use_quota=True,user_id='98b1cd20981f4b99a69caeef50f68604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)}" {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Creating volume 45142e02-ee4d-445e-92a4-8d2772639278 {{(pid=87211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:26:29 devstack cinder-volume[87211]: INFO cinder.volume.drivers.remotefs [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] casted to osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278 1073741824 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:29 devstack sudo[109462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278 1073741824 Sep 25 17:26:29 devstack sudo[109462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:29 devstack sudo[109462]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278 1073741824" returned: 0 in 0.449s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:29 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:29 devstack sudo[109467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278 Sep 25 17:26:29 devstack sudo[109467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:30 devstack sudo[109467]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278" returned: 0 in 0.246s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'} {{(pid=87211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:26:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1232a89-a64c-4cf4-b3cd-d3276c2a14b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45142e02-ee4d-445e-92a4-8d2772639278', 'volume_size': 1}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c27772-6b20-4ab3-b254-d196d452cd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:30 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Volume volume-45142e02-ee4d-445e-92a4-8d2772639278 (45142e02-ee4d-445e-92a4-8d2772639278): created successfully Sep 25 17:26:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c27772-6b20-4ab3-b254-d196d452cd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:30 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Flow 'volume_create_manager' (46e940d2-d465-4f92-8572-f6e99980a8bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:30 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-3accc36f-be66-4154-9422-fa6a505aee3b tempest-SnapshotDependencyTests-173058634 None] Created volume successfully. Sep 25 17:26:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ace9ad6-7df0-49ac-871d-573c09c38031 tempest-SnapshotDependencyTests-173058634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ace9ad6-7df0-49ac-871d-573c09c38031 tempest-SnapshotDependencyTests-173058634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:30 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-9ace9ad6-7df0-49ac-871d-573c09c38031 tempest-SnapshotDependencyTests-173058634 None] Creating offline snapshot 81aec3f0-8a12-495b-8557-01894064bffa of volume 45142e02-ee4d-445e-92a4-8d2772639278 {{(pid=87211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:26:30 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98aee9c-5278-44a8-a93c-72f957d81181]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ace9ad6-7df0-49ac-871d-573c09c38031 tempest-SnapshotDependencyTests-173058634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:30 devstack sudo[109470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278 Sep 25 17:26:30 devstack sudo[109470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:30 devstack sudo[109470]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ace9ad6-7df0-49ac-871d-573c09c38031 tempest-SnapshotDependencyTests-173058634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278" returned: 0 in 0.374s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:30 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ace9ad6-7df0-49ac-871d-573c09c38031 tempest-SnapshotDependencyTests-173058634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa 1G {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:30 devstack sudo[109475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa 1G Sep 25 17:26:30 devstack sudo[109475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:31 devstack sudo[109475]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ace9ad6-7df0-49ac-871d-573c09c38031 tempest-SnapshotDependencyTests-173058634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa 1G" returned: 0 in 0.414s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ace9ad6-7df0-49ac-871d-573c09c38031 tempest-SnapshotDependencyTests-173058634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45142e02-ee4d-445e-92a4-8d2772639278 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:31 devstack sudo[109480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45142e02-ee4d-445e-92a4-8d2772639278 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa Sep 25 17:26:31 devstack sudo[109480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:31 devstack sudo[109480]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ace9ad6-7df0-49ac-871d-573c09c38031 tempest-SnapshotDependencyTests-173058634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45142e02-ee4d-445e-92a4-8d2772639278 -F qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa" returned: 0 in 0.295s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:31 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-9ace9ad6-7df0-49ac-871d-573c09c38031 tempest-SnapshotDependencyTests-173058634 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa is being set with open permissions: ugo+rw Sep 25 17:26:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ace9ad6-7df0-49ac-871d-573c09c38031 tempest-SnapshotDependencyTests-173058634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:31 devstack sudo[109485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa Sep 25 17:26:31 devstack sudo[109485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:31 devstack sudo[109485]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ace9ad6-7df0-49ac-871d-573c09c38031 tempest-SnapshotDependencyTests-173058634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa" returned: 0 in 0.253s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:31 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ace9ad6-7df0-49ac-871d-573c09c38031 tempest-SnapshotDependencyTests-173058634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:31 devstack sudo[109488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.info Sep 25 17:26:31 devstack sudo[109488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:32 devstack sudo[109488]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ace9ad6-7df0-49ac-871d-573c09c38031 tempest-SnapshotDependencyTests-173058634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.info" returned: 0 in 0.273s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:32 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-9ace9ad6-7df0-49ac-871d-573c09c38031 tempest-SnapshotDependencyTests-173058634 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.info is being set with open permissions: ugo+rw Sep 25 17:26:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ace9ad6-7df0-49ac-871d-573c09c38031 tempest-SnapshotDependencyTests-173058634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.info {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:32 devstack sudo[109491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.info Sep 25 17:26:32 devstack sudo[109491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:32 devstack sudo[109491]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ace9ad6-7df0-49ac-871d-573c09c38031 tempest-SnapshotDependencyTests-173058634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.info" returned: 0 in 0.254s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:32 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ace9ad6-7df0-49ac-871d-573c09c38031 tempest-SnapshotDependencyTests-173058634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.962s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:32 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-9ace9ad6-7df0-49ac-871d-573c09c38031 tempest-SnapshotDependencyTests-173058634 None] Create snapshot completed successfully Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.volume.flows.manager.create_volume [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Flow 'volume_create_manager' (083b9ca0-4d85-41c1-b4d3-300152d2a575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c31b6a-26f6-49d3-ad82-2dd5300ccb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c31b6a-26f6-49d3-ad82-2dd5300ccb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6d3954-4fa9-49e9-8f65-c929dc1bd861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b24976f9644c4bb5faef0ba705c857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=81aec3f0-8a12-495b-8557-01894064bffa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:26:33Z,use_quota=True,user_id='98b1cd20981f4b99a69caeef50f68604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3db9002-6e84-4b2a-b9bc-a91893592abe),volume_type_id=c3db9002-6e84-4b2a-b9bc-a91893592abe)' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bf2cbb-5e50-47c5-af1b-9b39c77d67d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bf2cbb-5e50-47c5-af1b-9b39c77d67d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6af2d3-bf34-4e90-8724-7700360f32dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6af2d3-bf34-4e90-8724-7700360f32dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0d6d3954-4fa9-49e9-8f65-c929dc1bd861', 'volume_name': 'volume-0d6d3954-4fa9-49e9-8f65-c929dc1bd861', 'volume_size': 1, 'snapshot_id': '81aec3f0-8a12-495b-8557-01894064bffa'}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99aad54-b004-40a8-83ef-7bca7af22da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99aad54-b004-40a8-83ef-7bca7af22da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b159b1-d410-42c6-b0d6-505666ea6c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:33 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Volume 0d6d3954-4fa9-49e9-8f65-c929dc1bd861: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0d6d3954-4fa9-49e9-8f65-c929dc1bd861', 'volume_size': 1, 'snapshot_id': '81aec3f0-8a12-495b-8557-01894064bffa'} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Acquiring lock "cinder-quobyte-81aec3f0-8a12-495b-8557-01894064bffa-0d6d3954-4fa9-49e9-8f65-c929dc1bd861" by "_create_volume_from_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Lock "cinder-quobyte-81aec3f0-8a12-495b-8557-01894064bffa-0d6d3954-4fa9-49e9-8f65-c929dc1bd861" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Creating volume 0d6d3954-4fa9-49e9-8f65-c929dc1bd861 from snapshot 81aec3f0-8a12-495b-8557-01894064bffa {{(pid=87211) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Selected osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081 as target Quobyte volume. {{(pid=87211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Acquiring lock "cinder-quobyte-0d6d3954-4fa9-49e9-8f65-c929dc1bd861" by "_copy_volume_from_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Lock "cinder-quobyte-0d6d3954-4fa9-49e9-8f65-c929dc1bd861" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] snapshot: 81aec3f0-8a12-495b-8557-01894064bffa, volume: 0d6d3954-4fa9-49e9-8f65-c929dc1bd861, {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[536b3890-184d-45cf-96a7-a8814ce3d556]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:33 devstack sudo[109494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa Sep 25 17:26:33 devstack sudo[109494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:33 devstack sudo[109494]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa" returned: 0 in 0.355s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45142e02-ee4d-445e-92a4-8d2772639278(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[7206dfa3-6edb-4ce4-9222-362f792aec3a]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:33 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:33 devstack sudo[109499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278 Sep 25 17:26:33 devstack sudo[109499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:34 devstack sudo[109499]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278" returned: 0 in 0.354s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] will copy from snapshot at /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278 {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:26:34 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Creating direct copy from snapshot {{(pid=87211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:26:34 devstack cinder-volume[87211]: DEBUG cinder.utils [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Path /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d6d3954-4fa9-49e9-8f65-c929dc1bd861 not found in is_blk_device check {{(pid=87211) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:26:34 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d6d3954-4fa9-49e9-8f65-c929dc1bd861 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:34 devstack sudo[109504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d6d3954-4fa9-49e9-8f65-c929dc1bd861 Sep 25 17:26:34 devstack sudo[109504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:39 devstack sudo[109504]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d6d3954-4fa9-49e9-8f65-c929dc1bd861" returned: 0 in 5.803s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:39 devstack cinder-volume[87211]: DEBUG cinder.image.image_utils [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Image conversion details: src /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d6d3954-4fa9-49e9-8f65-c929dc1bd861 {{(pid=87211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:26:39 devstack cinder-volume[87211]: INFO cinder.image.image_utils [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Converted 1024.00 MB image at 176.42 MB/s Sep 25 17:26:39 devstack cinder-volume[87211]: WARNING cinder.volume.drivers.remotefs [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d6d3954-4fa9-49e9-8f65-c929dc1bd861 is being set with open permissions: ugo+rw Sep 25 17:26:39 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d6d3954-4fa9-49e9-8f65-c929dc1bd861 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:39 devstack sudo[109518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d6d3954-4fa9-49e9-8f65-c929dc1bd861 Sep 25 17:26:39 devstack sudo[109518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:40 devstack sudo[109518]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d6d3954-4fa9-49e9-8f65-c929dc1bd861" returned: 0 in 0.252s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Lock "cinder-quobyte-0d6d3954-4fa9-49e9-8f65-c929dc1bd861" released by "_copy_volume_from_snapshot" :: held 6.845s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Lock "cinder-quobyte-81aec3f0-8a12-495b-8557-01894064bffa-0d6d3954-4fa9-49e9-8f65-c929dc1bd861" released by "_create_volume_from_snapshot" :: held 6.906s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.923s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b159b1-d410-42c6-b0d6-505666ea6c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d6d3954-4fa9-49e9-8f65-c929dc1bd861', 'volume_size': 1, 'snapshot_id': '81aec3f0-8a12-495b-8557-01894064bffa'}' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb257087-3715-4ea5-9c8a-5429841aad22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:40 devstack cinder-volume[87211]: INFO cinder.volume.flows.manager.create_volume [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Volume volume-0d6d3954-4fa9-49e9-8f65-c929dc1bd861 (0d6d3954-4fa9-49e9-8f65-c929dc1bd861): created successfully Sep 25 17:26:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb257087-3715-4ea5-9c8a-5429841aad22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87211) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:40 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Flow 'volume_create_manager' (083b9ca0-4d85-41c1-b4d3-300152d2a575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87211) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:40 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-d256b50d-3603-423e-989a-54be49c8cc1d tempest-SnapshotDependencyTests-173058634 None] Created volume successfully. Sep 25 17:26:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-39869122-99ef-4c18-9323-ed49b1b9c3ab tempest-SnapshotDependencyTests-173058634 None] Acquiring lock "cinder-81aec3f0-8a12-495b-8557-01894064bffa-delete_snapshot" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-39869122-99ef-4c18-9323-ed49b1b9c3ab tempest-SnapshotDependencyTests-173058634 None] Lock "cinder-81aec3f0-8a12-495b-8557-01894064bffa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-39869122-99ef-4c18-9323-ed49b1b9c3ab tempest-SnapshotDependencyTests-173058634 None] Acquiring lock "cinder-quobyte-45142e02-ee4d-445e-92a4-8d2772639278" by "delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-39869122-99ef-4c18-9323-ed49b1b9c3ab tempest-SnapshotDependencyTests-173058634 None] Lock "cinder-quobyte-45142e02-ee4d-445e-92a4-8d2772639278" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-39869122-99ef-4c18-9323-ed49b1b9c3ab tempest-SnapshotDependencyTests-173058634 None] Acquiring lock "cinder-quobyte-81aec3f0-8a12-495b-8557-01894064bffa" by "_delete_snapshot" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:40 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-39869122-99ef-4c18-9323-ed49b1b9c3ab tempest-SnapshotDependencyTests-173058634 None] Lock "cinder-quobyte-81aec3f0-8a12-495b-8557-01894064bffa" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-39869122-99ef-4c18-9323-ed49b1b9c3ab tempest-SnapshotDependencyTests-173058634 None] Deleting offline snapshot 81aec3f0-8a12-495b-8557-01894064bffa of volume 45142e02-ee4d-445e-92a4-8d2772639278 {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:26:40 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-39869122-99ef-4c18-9323-ed49b1b9c3ab tempest-SnapshotDependencyTests-173058634 None] snapshot_file for this snap is: volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa {{(pid=87211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:26:40 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5920e68-da7f-43de-a9a7-ffc238432a46]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:40 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-39869122-99ef-4c18-9323-ed49b1b9c3ab tempest-SnapshotDependencyTests-173058634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:40 devstack sudo[109521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa Sep 25 17:26:40 devstack sudo[109521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:41 devstack sudo[109521]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-39869122-99ef-4c18-9323-ed49b1b9c3ab tempest-SnapshotDependencyTests-173058634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa" returned: 0 in 0.368s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:41 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.remotefs [None req-39869122-99ef-4c18-9323-ed49b1b9c3ab tempest-SnapshotDependencyTests-173058634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45142e02-ee4d-445e-92a4-8d2772639278(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:26:41 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[13287454-e221-414e-8c40-2303e8d9e8ae]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-39869122-99ef-4c18-9323-ed49b1b9c3ab tempest-SnapshotDependencyTests-173058634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:41 devstack sudo[109526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278 Sep 25 17:26:41 devstack sudo[109526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:41 devstack sudo[109526]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-39869122-99ef-4c18-9323-ed49b1b9c3ab tempest-SnapshotDependencyTests-173058634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278" returned: 0 in 0.547s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:41 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-39869122-99ef-4c18-9323-ed49b1b9c3ab tempest-SnapshotDependencyTests-173058634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:41 devstack sudo[109537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa Sep 25 17:26:41 devstack sudo[109537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:42 devstack sudo[109537]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-39869122-99ef-4c18-9323-ed49b1b9c3ab tempest-SnapshotDependencyTests-173058634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa" returned: 0 in 0.354s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-39869122-99ef-4c18-9323-ed49b1b9c3ab tempest-SnapshotDependencyTests-173058634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:42 devstack sudo[109542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa Sep 25 17:26:42 devstack sudo[109542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:42 devstack sudo[109542]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:42 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-39869122-99ef-4c18-9323-ed49b1b9c3ab tempest-SnapshotDependencyTests-173058634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278.81aec3f0-8a12-495b-8557-01894064bffa" returned: 0 in 0.266s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-39869122-99ef-4c18-9323-ed49b1b9c3ab tempest-SnapshotDependencyTests-173058634 None] Lock "cinder-quobyte-81aec3f0-8a12-495b-8557-01894064bffa" released by "_delete_snapshot" :: held 1.642s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-39869122-99ef-4c18-9323-ed49b1b9c3ab tempest-SnapshotDependencyTests-173058634 None] Lock "cinder-quobyte-45142e02-ee4d-445e-92a4-8d2772639278" released by "delete_snapshot" :: held 1.665s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:42 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-39869122-99ef-4c18-9323-ed49b1b9c3ab tempest-SnapshotDependencyTests-173058634 None] Created reservations ['90262600-ba04-43f1-9a03-6d54a5703a67', '6f143dbf-06e7-4b9a-8e74-d1d564d3d17c', 'f06107f0-6a11-4372-b749-c8df0bc83761', '7c73538f-67d8-48dc-8624-5515e0806068'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:26:42 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-39869122-99ef-4c18-9323-ed49b1b9c3ab tempest-SnapshotDependencyTests-173058634 None] Delete snapshot completed successfully. Sep 25 17:26:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-39869122-99ef-4c18-9323-ed49b1b9c3ab tempest-SnapshotDependencyTests-173058634 None] Lock "cinder-81aec3f0-8a12-495b-8557-01894064bffa-delete_snapshot" released by "delete_snapshot" :: held 1.809s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-321618b1-d705-4436-b7d2-9ba15ae546e6 tempest-SnapshotDependencyTests-173058634 None] Acquiring lock "cinder-45142e02-ee4d-445e-92a4-8d2772639278-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-321618b1-d705-4436-b7d2-9ba15ae546e6 tempest-SnapshotDependencyTests-173058634 None] Lock "cinder-45142e02-ee4d-445e-92a4-8d2772639278-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:42 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-321618b1-d705-4436-b7d2-9ba15ae546e6 tempest-SnapshotDependencyTests-173058634 None] Acquiring lock "cinder-quobyte-45142e02-ee4d-445e-92a4-8d2772639278" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-321618b1-d705-4436-b7d2-9ba15ae546e6 tempest-SnapshotDependencyTests-173058634 None] Lock "cinder-quobyte-45142e02-ee4d-445e-92a4-8d2772639278" acquired by "delete_volume" :: waited 0.017s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:43 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5080f3b2-f0e2-484f-a96a-ff2c814ea089]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-321618b1-d705-4436-b7d2-9ba15ae546e6 tempest-SnapshotDependencyTests-173058634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:43 devstack sudo[109545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278 Sep 25 17:26:43 devstack sudo[109545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:43 devstack sudo[109545]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-321618b1-d705-4436-b7d2-9ba15ae546e6 tempest-SnapshotDependencyTests-173058634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278" returned: 0 in 0.403s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-321618b1-d705-4436-b7d2-9ba15ae546e6 tempest-SnapshotDependencyTests-173058634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:43 devstack sudo[109551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278 Sep 25 17:26:43 devstack sudo[109551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:43 devstack sudo[109551]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-321618b1-d705-4436-b7d2-9ba15ae546e6 tempest-SnapshotDependencyTests-173058634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-45142e02-ee4d-445e-92a4-8d2772639278" returned: 0 in 0.265s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:43 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-321618b1-d705-4436-b7d2-9ba15ae546e6 tempest-SnapshotDependencyTests-173058634 None] Lock "cinder-quobyte-45142e02-ee4d-445e-92a4-8d2772639278" released by "delete_volume" :: held 0.733s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:43 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-321618b1-d705-4436-b7d2-9ba15ae546e6 tempest-SnapshotDependencyTests-173058634 None] Created reservations ['fa816ba9-5c83-4bf5-ad41-f8895d7ca94b', 'b97c33cf-5266-4843-b05e-0d110bccdc56', '966cac70-870f-497d-b176-0f539a86088e', 'a8244aa6-fe60-48e5-9889-c52367a18267'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:26:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-321618b1-d705-4436-b7d2-9ba15ae546e6 tempest-SnapshotDependencyTests-173058634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-321618b1-d705-4436-b7d2-9ba15ae546e6 tempest-SnapshotDependencyTests-173058634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-321618b1-d705-4436-b7d2-9ba15ae546e6 tempest-SnapshotDependencyTests-173058634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:43 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-321618b1-d705-4436-b7d2-9ba15ae546e6 tempest-SnapshotDependencyTests-173058634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-321618b1-d705-4436-b7d2-9ba15ae546e6 tempest-SnapshotDependencyTests-173058634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:43 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-321618b1-d705-4436-b7d2-9ba15ae546e6 tempest-SnapshotDependencyTests-173058634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:43 devstack sudo[109554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:26:43 devstack sudo[109554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:44 devstack sudo[109554]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-321618b1-d705-4436-b7d2-9ba15ae546e6 tempest-SnapshotDependencyTests-173058634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.242s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:44 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-321618b1-d705-4436-b7d2-9ba15ae546e6 tempest-SnapshotDependencyTests-173058634 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:26:44 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-44acc9dd-f24d-40d8-9d64-64617adc7b78 tempest-SnapshotDependencyTests-173058634 None] Acquiring lock "cinder-0d6d3954-4fa9-49e9-8f65-c929dc1bd861-delete_volume" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:44 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-321618b1-d705-4436-b7d2-9ba15ae546e6 tempest-SnapshotDependencyTests-173058634 None] Deleted volume successfully. Sep 25 17:26:44 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-44acc9dd-f24d-40d8-9d64-64617adc7b78 tempest-SnapshotDependencyTests-173058634 None] Lock "cinder-0d6d3954-4fa9-49e9-8f65-c929dc1bd861-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:44 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-321618b1-d705-4436-b7d2-9ba15ae546e6 tempest-SnapshotDependencyTests-173058634 None] Lock "cinder-45142e02-ee4d-445e-92a4-8d2772639278-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:44 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-44acc9dd-f24d-40d8-9d64-64617adc7b78 tempest-SnapshotDependencyTests-173058634 None] Acquiring lock "cinder-quobyte-0d6d3954-4fa9-49e9-8f65-c929dc1bd861" by "delete_volume" {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:44 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-44acc9dd-f24d-40d8-9d64-64617adc7b78 tempest-SnapshotDependencyTests-173058634 None] Lock "cinder-quobyte-0d6d3954-4fa9-49e9-8f65-c929dc1bd861" acquired by "delete_volume" :: waited 0.016s {{(pid=87211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:44 devstack cinder-volume[87211]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ceebef-7ebb-4386-9617-82a9ab0c33b3]: (4, 'qcow2') {{(pid=88017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-44acc9dd-f24d-40d8-9d64-64617adc7b78 tempest-SnapshotDependencyTests-173058634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d6d3954-4fa9-49e9-8f65-c929dc1bd861 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:44 devstack sudo[109591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d6d3954-4fa9-49e9-8f65-c929dc1bd861 Sep 25 17:26:44 devstack sudo[109591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:44 devstack sudo[109591]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-44acc9dd-f24d-40d8-9d64-64617adc7b78 tempest-SnapshotDependencyTests-173058634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d6d3954-4fa9-49e9-8f65-c929dc1bd861" returned: 0 in 0.389s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-44acc9dd-f24d-40d8-9d64-64617adc7b78 tempest-SnapshotDependencyTests-173058634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d6d3954-4fa9-49e9-8f65-c929dc1bd861 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:44 devstack sudo[109598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d6d3954-4fa9-49e9-8f65-c929dc1bd861 Sep 25 17:26:44 devstack sudo[109598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:44 devstack sudo[109598]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-44acc9dd-f24d-40d8-9d64-64617adc7b78 tempest-SnapshotDependencyTests-173058634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688/volume-0d6d3954-4fa9-49e9-8f65-c929dc1bd861" returned: 0 in 0.257s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:44 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-44acc9dd-f24d-40d8-9d64-64617adc7b78 tempest-SnapshotDependencyTests-173058634 None] Lock "cinder-quobyte-0d6d3954-4fa9-49e9-8f65-c929dc1bd861" released by "delete_volume" :: held 0.704s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:44 devstack cinder-volume[87211]: DEBUG cinder.quota [None req-44acc9dd-f24d-40d8-9d64-64617adc7b78 tempest-SnapshotDependencyTests-173058634 None] Created reservations ['78710b3b-9d66-4d6e-aa45-56dbc11c6749', 'b8cafbf4-a21e-4774-ab96-ace9c35352a6', '28f4485c-ba10-427d-9aea-11191f808989', '4957e589-c1c3-4ddb-9397-0b260c157783'] {{(pid=87211) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:26:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-44acc9dd-f24d-40d8-9d64-64617adc7b78 tempest-SnapshotDependencyTests-173058634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-44acc9dd-f24d-40d8-9d64-64617adc7b78 tempest-SnapshotDependencyTests-173058634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-44acc9dd-f24d-40d8-9d64-64617adc7b78 tempest-SnapshotDependencyTests-173058634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:44 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-44acc9dd-f24d-40d8-9d64-64617adc7b78 tempest-SnapshotDependencyTests-173058634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-44acc9dd-f24d-40d8-9d64-64617adc7b78 tempest-SnapshotDependencyTests-173058634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:44 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-44acc9dd-f24d-40d8-9d64-64617adc7b78 tempest-SnapshotDependencyTests-173058634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:45 devstack sudo[109601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:26:45 devstack sudo[109601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:45 devstack sudo[109601]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:45 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-44acc9dd-f24d-40d8-9d64-64617adc7b78 tempest-SnapshotDependencyTests-173058634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.258s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:45 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-44acc9dd-f24d-40d8-9d64-64617adc7b78 tempest-SnapshotDependencyTests-173058634 None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:26:45 devstack cinder-volume[87211]: INFO cinder.volume.manager [None req-44acc9dd-f24d-40d8-9d64-64617adc7b78 tempest-SnapshotDependencyTests-173058634 None] Deleted volume successfully. Sep 25 17:26:45 devstack cinder-volume[87211]: DEBUG cinder.coordination [None req-44acc9dd-f24d-40d8-9d64-64617adc7b78 tempest-SnapshotDependencyTests-173058634 None] Lock "cinder-0d6d3954-4fa9-49e9-8f65-c929dc1bd861-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=87211) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:26:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081': None} {{(pid=87211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:53 devstack cinder-volume[87211]: DEBUG cinder.volume.drivers.quobyte [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1cc0d94-621e-4258-99d4-e613235fa081'] {{(pid=87211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.lockutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:53 devstack sudo[109612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688 Sep 25 17:26:53 devstack sudo[109612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:53 devstack sudo[109612]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:53 devstack cinder-volume[87211]: DEBUG oslo_concurrency.processutils [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/91b56ed4b445015b905559d748903688" returned: 0 in 0.259s {{(pid=87211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:53 devstack cinder-volume[87211]: DEBUG cinder.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Notifying Schedulers of capabilities ... {{(pid=87211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:26:53 devstack cinder-volume[87211]: DEBUG oslo_service.periodic_task [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] Running periodic task VolumeManager._thread_info {{(pid=87211) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:26:53 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread count: 28 {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:26:53 devstack cinder-volume[87211]: DEBUG cinder.volume.manager [None req-9ff94b59-d2f8-4c98-96fb-b15e7e7b7535 None None] thread info: [<_MainThread(MainThread, started 137459116765312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87211) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:26:54 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=27,cinder:UPDATE=29,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:26:55 devstack cinder-volume[87211]: DEBUG dbcounter [-] [87211] Writing DB stats cinder:SELECT=22,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}